-- Logs begin at Sat 2021-11-20 02:46:18 UTC, end at Sat 2021-11-20 03:42:18 UTC. -- Nov 20 03:16:15.254793 dv-cinder-818037-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 20 03:16:15.264139 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 20 03:16:15.266122 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Nov 20 03:16:15 2021] *** Nov 20 03:16:15.266122 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 20 03:16:15.266122 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 20 03:16:15.266122 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: nodename: dv-cinder-818037-5-iscsi Nov 20 03:16:15.266122 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: machine: x86_64 Nov 20 03:16:15.266122 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: clock source: unix Nov 20 03:16:15.266122 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: pcre jit disabled Nov 20 03:16:15.266122 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: detected number of CPU cores: 4 Nov 20 03:16:15.266122 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: current working directory: / Nov 20 03:16:15.266122 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: detected binary path: /usr/bin/uwsgi-core Nov 20 03:16:15.266835 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: your processes number limit is 47680 Nov 20 03:16:15.266835 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: your memory page size is 4096 bytes Nov 20 03:16:15.266835 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: detected max file descriptor number: 2048 Nov 20 03:16:15.266835 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: lock engine: pthread robust mutexes Nov 20 03:16:15.266835 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: thunder lock: enabled Nov 20 03:16:15.266835 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 20 03:16:15.266835 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 20 03:16:15.310213 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: Python main interpreter initialized at 0x558cfc8f19c0 Nov 20 03:16:15.310213 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: python threads support enabled Nov 20 03:16:15.310213 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: your server socket listen backlog is limited to 100 connections Nov 20 03:16:15.310213 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: your mercy for graceful operations on workers is 90 seconds Nov 20 03:16:15.310532 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: mapped 403077 bytes (393 KB) for 2 cores Nov 20 03:16:15.310605 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: *** Operational MODE: preforking *** Nov 20 03:16:15.310869 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: *** uWSGI is running in multiple interpreter mode *** Nov 20 03:16:15.310869 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: spawned uWSGI master process (pid: 101882) Nov 20 03:16:15.311057 dv-cinder-818037-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 20 03:16:15.315428 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: spawned uWSGI worker 1 (pid: 101883, cores: 1) Nov 20 03:16:15.315428 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: spawned uWSGI worker 2 (pid: 101884, cores: 1) Nov 20 03:16:15.315428 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 20 03:16:16.923156 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 20 03:16:16.923156 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: from cryptography.utils import int_from_bytes Nov 20 03:16:16.923677 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 20 03:16:16.923677 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: from cryptography.utils import int_from_bytes Nov 20 03:16:16.924208 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 20 03:16:16.924208 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: from cryptography.utils import int_from_bytes Nov 20 03:16:16.924677 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 20 03:16:16.924677 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: from cryptography.utils import int_from_bytes Nov 20 03:16:19.416188 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 20 03:16:19.416716 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 20 03:16:19.417064 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 20 03:16:19.417162 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 20 03:16:19.417244 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 20 03:16:19.417331 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 20 03:16:19.417331 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 20 03:16:19.417486 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 20 03:16:19.417562 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 20 03:16:19.417628 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 20 03:16:19.417914 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.418018 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.418241 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.418349 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.418561 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.418648 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.418879 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.418972 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.419214 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.419318 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.419528 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.419613 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.419881 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.419982 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.420209 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.420294 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.420538 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.420628 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.420804 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.420904 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.421125 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.421222 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.421450 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-5-iscsi {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.421535 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-5-iscsi {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.421773 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.421864 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.422084 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.422176 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.422397 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.422482 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.422718 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.422803 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.423024 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.423124 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.423348 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.423440 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.423655 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.423741 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.424201 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.424304 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.424626 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.424922 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.425037 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.425236 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.425355 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.425554 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.425679 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.425892 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.425971 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.426183 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.426269 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.426507 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.426645 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.426820 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.426911 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.427130 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.427263 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.427449 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.427584 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.427759 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.427918 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-5-iscsi {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.428187 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.428296 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-5-iscsi {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.428510 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.428615 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.428823 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.428924 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.429144 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.429242 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.429539 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.429653 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.429854 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.429950 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.430169 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.430267 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.430521 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.430617 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.430843 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.430932 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.431160 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.431294 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.431486 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.431590 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.431824 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.431925 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.432154 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.432239 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.432461 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.432547 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.432775 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.432869 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.433086 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.433171 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.433405 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.433505 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.433707 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.433791 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.434015 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.434101 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.434272 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.434365 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.434566 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.434657 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.434881 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.434977 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.435203 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.435288 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.435527 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.435613 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.435861 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.435969 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.436057 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.436142 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.436363 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.436448 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.436684 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.436778 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.436998 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.437092 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.437309 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.437402 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.437618 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.437709 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.437925 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.438011 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.438233 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.438326 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.438545 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.438657 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.438853 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.438953 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.439161 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.439262 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.439473 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.439586 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.439807 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.439911 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.440130 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.440233 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.440441 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.440539 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.440749 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.440844 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.441073 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.441170 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.441399 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.441501 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.441706 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.441793 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.442017 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.442103 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.442354 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.442440 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.442670 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.442755 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.442980 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.443066 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.443301 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.443386 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.443614 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.443699 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.443947 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.444046 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.444255 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.444340 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.444566 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.444658 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.444891 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.444978 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.445201 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.445285 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.445456 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.445551 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.445761 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.445853 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.446589 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.446681 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.446901 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.446995 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.447211 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.447295 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.447519 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.447605 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.447845 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.447945 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.448153 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.448239 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.448455 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.448551 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.448766 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.448875 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.449070 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.449162 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.449377 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.449468 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.449684 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.449777 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.449990 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.450080 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.450299 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.450390 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.450604 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.450696 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.450911 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.450995 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.451220 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.451306 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.451546 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.451642 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.451876 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.451965 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.452188 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.452281 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.452496 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.452584 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.452804 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.452898 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.453112 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.453205 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.453422 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.453507 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.453734 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.453818 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.454056 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.454140 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.454367 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.454453 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.454675 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.454762 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.454995 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.455081 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.455305 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.455392 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.455612 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.455703 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.455958 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.456047 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.456266 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.456356 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.456573 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.456659 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.456885 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.456977 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.457194 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.457279 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.457503 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.457589 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.457811 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.457909 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.458118 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.458210 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.458424 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.458514 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.458729 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.458878 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.459035 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.459120 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.459336 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.459443 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.459636 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.459729 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.459979 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.460127 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.460302 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.460461 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.460616 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.460789 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.460928 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.461105 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.461243 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.461416 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.461564 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.461790 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.462480 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.462635 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:16:19.462817 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.462975 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.463166 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.463312 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.463486 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.463661 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.463841 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.464010 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.464180 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.464352 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.464502 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.464691 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.464819 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.465016 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.465139 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.465332 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.465468 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.465651 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.465783 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.465983 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.466099 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.466299 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.466415 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.466616 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.466736 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.466932 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.467058 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.467254 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.467392 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.467576 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.467715 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.467936 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.468059 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.468256 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.468383 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.468576 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.468690 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.468900 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.469008 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.469215 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.469338 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.469536 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.469663 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.469868 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.469980 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.470194 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.470326 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.470513 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.470670 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.470859 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.470990 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.471205 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.471323 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.471526 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.471642 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.471879 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.471994 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.472197 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.472315 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.472524 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.472623 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.472840 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.472927 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.473158 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.473246 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.473476 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.473570 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.473815 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.473902 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.474131 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.474218 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.474447 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.474542 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.474786 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.474874 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.475104 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.475197 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.475412 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.475498 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.475723 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.475823 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.476058 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.476143 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.476368 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.476454 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.476678 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.477023 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.477293 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.477388 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.477618 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.477712 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.477949 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.478043 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.478261 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.478354 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.478582 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.478670 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.478891 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.478982 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.479200 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.479298 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.479511 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.479596 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.479844 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.479934 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.480158 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.480259 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.480477 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.480569 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.480787 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.480873 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.481105 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.481198 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.481417 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.481502 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.481726 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.481892 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.482079 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.482174 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.482402 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.482488 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.482721 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.482815 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.483040 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.483194 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.483359 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.483519 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.483687 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.483861 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.484030 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.484181 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.484348 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.484512 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.484687 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.484831 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.485026 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.485149 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.485340 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.485488 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.485672 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.485824 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.486001 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.486134 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.486325 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.486463 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.486636 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.486792 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.486954 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.487115 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.487265 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.487427 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.487577 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.487741 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.487911 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.488077 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.488229 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.488387 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.488542 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.488696 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.488854 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.489011 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.489164 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.489322 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.489475 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.489632 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.489787 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.489940 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.490115 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.490252 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.490432 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.490561 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.490745 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.490888 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.491057 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.491202 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.491371 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.491512 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.491719 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.491841 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.492058 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.492144 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.492405 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.492494 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.492745 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.492848 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.493096 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.493192 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.493422 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.493510 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.493741 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.493871 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.494066 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.494161 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.494383 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.494470 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.494702 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.494788 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.495017 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.495110 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.495334 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.495419 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.495654 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.495746 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.495994 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.496093 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.496318 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.496410 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.496636 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.496722 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.496958 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.497052 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.497273 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.497358 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.497599 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.497685 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.497911 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.497998 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.498233 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.498319 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.498543 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.498630 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.498867 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.498955 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.499211 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.499343 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.499538 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.499623 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.499882 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.499982 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.500206 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.500297 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.500524 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.500619 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.500842 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.500928 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.501159 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.501245 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.501474 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.501559 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.501787 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.501874 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.502104 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.502192 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.502427 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.502524 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.502740 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.502825 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.503065 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.503158 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.503381 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.503473 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.503706 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.503837 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.504046 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.504135 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.504368 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.504534 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.504681 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.504768 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.505001 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.505087 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.505329 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.505422 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.505648 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.505735 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.505965 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.506056 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.506282 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.506368 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.506599 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.506720 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.506914 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.506999 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.507224 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.507310 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.507537 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.507622 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.507873 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.507972 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.508186 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.508279 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.509012 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.509104 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.509339 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.509433 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.509651 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.509739 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.509966 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.510050 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.510279 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.510372 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.510592 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.510678 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.510901 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.510993 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.511210 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.511304 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.511523 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.511611 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.511864 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.511952 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.512195 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.512296 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.512511 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.512598 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.512821 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.512907 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.513133 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.513230 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.513445 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.513530 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.513755 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.513842 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.514063 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.514170 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.514375 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.514461 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.514682 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.514775 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.514991 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.515079 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.515299 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.515385 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.515626 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.515712 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.515971 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.516060 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.516278 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.516366 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.516598 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.516684 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.516915 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.517002 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.517224 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.517316 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.517536 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.517630 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.517849 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.517935 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.518164 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.518270 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.518477 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.518570 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.518794 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.518881 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.519103 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.519188 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.519416 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.519510 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.519730 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.519850 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.520071 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.520156 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.520384 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.520482 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.520699 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.520785 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.521016 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.521101 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.521325 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.521413 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.521638 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.521723 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.521951 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.522037 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.522267 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.522520 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.522609 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.522861 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.523136 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.523223 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.523473 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.523560 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.523805 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.523893 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.524248 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.524830 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.525085 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.525174 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.525412 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.525500 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.525732 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.525826 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.526046 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.526132 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.526364 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.526455 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.526673 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.526766 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.526982 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.527066 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.527292 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.527384 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.527612 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.527706 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.527938 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.528027 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.528245 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.528341 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.528557 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.528652 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.528865 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.528953 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.529176 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.529268 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.529482 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.529568 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.529791 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.529880 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.530127 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.530225 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.530434 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.530533 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.530749 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.530845 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.531060 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.531146 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.531372 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.531503 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.531684 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.531779 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.532016 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.532102 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.532331 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.532452 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.532636 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.532749 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.532941 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.533048 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.533248 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.533361 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.533597 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.533700 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.533903 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.534002 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.534245 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.534346 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.534555 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.534643 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.534866 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.534952 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.535195 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.535281 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.535501 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.535587 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.535828 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.535917 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.536142 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.536242 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.536449 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.536541 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.536756 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.536844 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.537063 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.537156 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.537371 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.537457 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.537678 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.537765 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.537991 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.538084 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.538299 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.538385 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.538605 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.538690 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.538912 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.539009 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.539217 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.539310 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.539527 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.539614 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.539901 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.540000 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.540215 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.540301 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.540524 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.540610 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.540841 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.540930 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.541156 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.541249 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.541464 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.541597 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.541773 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.541859 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.542078 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.542162 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.542443 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.542547 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.542689 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.542783 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.542995 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.543080 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.543302 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.543395 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.543609 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.543695 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.543948 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.544038 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.544257 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.544398 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.544568 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.544655 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.544876 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.544962 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.545181 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.545275 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.545490 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.545577 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.545796 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.545881 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.546101 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.546198 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.546408 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.546495 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.546714 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.546805 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.547021 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.547115 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.547331 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.547420 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.547639 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.547723 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.547979 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.548069 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.548290 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.548383 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.548599 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.548686 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.548906 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.548992 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.549214 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.549302 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.549518 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.549603 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.549827 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.549914 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.550129 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.550221 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.550435 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.550533 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.550741 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.550827 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.551053 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.551139 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.551359 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.551454 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.551670 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.551763 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.552006 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.552104 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.552311 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.552405 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.552620 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.552718 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.552924 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.553017 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.553270 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.553365 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.553575 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.553668 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.553903 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.553995 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.554230 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.554317 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.554547 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.554632 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.554862 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.554947 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.555183 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.555270 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.555518 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.555605 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.555864 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.555952 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.556185 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.556279 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.556506 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.556592 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.556817 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.556902 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.557128 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.557221 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.557436 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.557524 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.557746 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.557832 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.558060 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.558146 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.558374 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.558466 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.558689 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.558848 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.559015 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.559109 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.559321 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.559419 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.559638 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.559740 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.559979 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.560065 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.560292 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.560379 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.560605 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.560698 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.560918 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.561003 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.561229 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.561321 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.561543 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.561637 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.561860 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.561949 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.562173 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.562257 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.562485 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.562572 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.562796 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.562892 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.563106 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.563198 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.563417 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.563504 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.563727 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.563832 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.564065 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.564161 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.564377 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.564465 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.564684 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.564768 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.564999 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.565086 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.565306 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.565393 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.565618 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.565703 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.565926 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.566023 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.566239 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.566333 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.566547 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.566655 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.566971 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.567064 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.567284 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.567370 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.567598 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.567683 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.567932 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.568033 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.568249 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.568336 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.568564 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.568651 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.568871 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.568964 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.569191 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.569278 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.569501 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.569587 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.569894 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.569980 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.570210 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.570297 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.570519 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.570604 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.570828 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.570915 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.571666 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.571759 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.572020 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.572176 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.572331 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.572524 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.572642 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.572953 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.573050 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.573277 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.573372 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.573588 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.573847 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.573934 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.574325 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.574420 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.574646 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.574929 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.575020 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.575365 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.575450 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.575682 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.575912 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.576557 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.577037 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.577521 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.577730 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.578080 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.578173 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.578420 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.578589 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.578758 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.578917 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.579076 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.579251 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.579401 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.579584 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.579723 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.579957 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.580084 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.580271 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.580415 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.580595 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.580735 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.580915 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.581059 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.581245 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.581370 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.581582 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.581698 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.581900 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.582025 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.582223 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.582337 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.582536 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.582665 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.582865 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.583090 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.583186 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.583420 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.583508 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.583738 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.583935 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.584089 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.584251 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.584422 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.584584 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.584738 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.584906 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.585050 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.585236 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.585367 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.585569 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.585679 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.585883 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.586000 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.586194 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.586288 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.586510 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.586597 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.587366 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.587471 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.587680 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.587779 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.588080 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.588168 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.588391 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.588493 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.588700 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.588787 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.589030 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.589117 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.589342 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.589430 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.589654 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.589742 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.589965 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.590051 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.590289 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.590384 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.590594 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.590680 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.590911 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.590997 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.591230 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.591324 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.591543 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.591629 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.591876 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.591977 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.592189 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.592278 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.592498 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.592592 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.592815 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.592910 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.593125 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.593213 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.593435 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.593528 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.593744 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.593839 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.594091 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.594179 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.594401 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.594494 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.594725 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.594820 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.595058 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.595380 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.595538 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.595706 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.595900 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.596061 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.596223 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.596372 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.596564 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.596683 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.596896 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.596984 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.597222 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.597309 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.597548 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.597636 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.597880 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.597987 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.598191 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.598277 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.598500 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.598593 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.598807 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.598894 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.599114 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.599206 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.599424 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.599518 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.599734 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.599852 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.600074 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.600162 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.600383 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.600479 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.600693 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.600779 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.600999 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.601085 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.601307 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.601400 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.601631 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.601717 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.602216 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.602323 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.602554 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.602822 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.602919 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.603000 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.603164 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.603253 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.603475 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.603571 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.603847 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.603940 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.604161 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.604261 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.604484 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.604571 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.604805 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.604894 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.605126 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.605220 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.605446 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.605535 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.605758 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.605845 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.606075 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.606169 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.606393 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.606482 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.606708 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.606795 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.607028 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.607122 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.607346 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.607433 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.607663 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.607750 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.608011 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.608297 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.608386 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.608627 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.608722 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.608945 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.609031 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.609259 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.609347 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.609575 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.609660 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.609894 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.610105 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.610270 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.610438 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.610526 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.610755 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.610844 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.611072 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.611172 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.611393 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.611481 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.611710 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.611852 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.612054 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.612151 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.612368 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.612456 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.612682 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.612770 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.612995 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.613084 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.613309 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.613397 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.613636 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.613730 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.613958 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.614045 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.614284 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.614371 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.614621 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.614718 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.614949 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.615037 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.615246 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.615341 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.615564 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.615653 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.615904 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.615993 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.616225 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.616311 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.616541 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.616631 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.616861 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.616948 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.617175 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.617261 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.617488 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.617577 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.617803 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.617908 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.618151 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.618258 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.618463 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.618550 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.618781 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.618879 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.619100 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.619195 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.619413 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.619501 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.619726 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.619838 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.620068 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.620168 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.620388 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.620476 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.620716 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.620907 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.621054 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.621228 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.621381 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.621566 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.621698 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.621895 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.622015 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.622225 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.622336 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.622549 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.622859 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.622946 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.623181 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.623269 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.623492 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.623577 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.623835 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.623925 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.624143 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.624239 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.624459 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.624547 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.624771 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.624908 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.625316 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.625465 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.625559 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.625640 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.625719 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.625809 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.626015 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.626102 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.626327 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.626413 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.626635 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.626869 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.626958 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.627225 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.627313 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.627551 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.627645 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.627896 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.627996 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.628216 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.628318 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.628555 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.628749 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.628870 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.629106 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.629193 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.629432 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.629564 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.629766 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.629896 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.630098 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.630187 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.630413 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.630499 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.630725 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.630813 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.631037 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.631123 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.631356 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.631445 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.631668 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.631755 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.632003 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.632090 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.632316 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.632415 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.632624 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.632711 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.632932 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.633025 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.633247 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.633381 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.634088 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.634193 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.634402 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.634490 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.634721 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.634818 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.635027 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.635114 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.635334 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.635456 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.635645 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.635749 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.635979 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.636068 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.636288 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.636376 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.636595 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.636682 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.636900 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.636987 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.637209 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.637297 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.637521 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.637618 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.637827 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.637914 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.638143 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.638243 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.638454 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.638561 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.638766 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.638892 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.639075 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.639162 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.639387 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.639475 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.639693 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.639780 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.640031 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.640128 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.640341 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.640429 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.640662 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.640747 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.640968 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.641071 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.641278 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.641365 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.641604 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.641691 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.641919 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.642146 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.642242 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.642532 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.642633 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.642855 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.642966 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.643197 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.643284 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.643517 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.643608 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.643865 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.644092 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.644189 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.644477 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.644565 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.644804 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.644889 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.645122 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.645211 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.645438 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.645578 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.645756 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.645845 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.646071 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.646160 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.646380 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.646465 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.646691 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.646790 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.647005 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.647094 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.647318 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.647411 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.647631 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.647838 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.647971 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.648065 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.648287 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.648375 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.648604 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.648712 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.648918 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.649054 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.649780 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.649877 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.650114 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.650211 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.650432 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.650520 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.650747 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.650834 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.651061 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.651150 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.651374 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.651462 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.651694 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.651800 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.652052 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.652141 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.652370 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.652465 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.652681 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.652767 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.652998 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.653098 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.653310 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.653404 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.653629 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.653726 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.653964 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.654053 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.654285 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.654373 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.654596 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.654692 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.654969 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.655055 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.655287 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.655376 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.655614 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.655710 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.655956 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.656046 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.656292 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.656382 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.656635 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.656724 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.656970 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.657057 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.657289 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.657383 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.657598 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.657685 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.657908 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.657995 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.658219 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.658308 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.658534 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.658622 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.658868 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.658955 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.659205 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.659305 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.659518 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.659604 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.659851 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.659944 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.660163 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.660264 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.660480 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.660572 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.660793 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.660879 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.661118 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.661214 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.661445 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.661538 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.661765 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.661854 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.662078 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.662180 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.662407 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.662496 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.662722 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.662815 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.663046 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.663165 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.663361 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.663461 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.663676 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.663764 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.664013 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.664101 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.664328 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.664415 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.664647 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.664751 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.664989 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.665085 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.665298 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.665384 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.665613 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.665708 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.665928 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.666015 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.666285 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.666379 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.666559 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.666658 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.666875 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.666964 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.667184 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.667269 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.667509 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.667603 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.667848 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.667949 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.668166 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.668252 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.668483 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.668572 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.668794 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.668882 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.669114 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.669247 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.669432 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.669521 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.669749 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.669837 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.670065 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.670153 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.670380 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.670469 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.670699 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.670794 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.671016 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.671104 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.671349 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.671438 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.671687 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.671798 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.672032 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.672130 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.672351 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.672445 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.672661 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.672748 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.672908 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 20 03:16:19.673005 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.673348 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.673682 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.674004 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.674321 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.674633 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:16:19.674880 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 20 03:16:19.695301 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG oslo_db.sqlalchemy.engines [None req-a0a6687c-f853-4da0-b1c9-dfa49a32193a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 03:16:19.697099 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG oslo_db.sqlalchemy.engines [None req-e262a27e-f0a4-4bc1-baa1-2ffbb6a4d965 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101883) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 03:16:19.763395 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.context [None req-a0a6687c-f853-4da0-b1c9-dfa49a32193a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),692e9fe6-a45f-4304-841f-fd5e8ac1537b(cell1) {{(pid=101884) load_cells /opt/stack/nova/nova/context.py:464}} Nov 20 03:16:19.764661 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.context [None req-e262a27e-f0a4-4bc1-baa1-2ffbb6a4d965 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),692e9fe6-a45f-4304-841f-fd5e8ac1537b(cell1) {{(pid=101883) load_cells /opt/stack/nova/nova/context.py:464}} Nov 20 03:16:19.767616 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG oslo_concurrency.lockutils [None req-a0a6687c-f853-4da0-b1c9-dfa49a32193a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:16:19.768851 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG oslo_concurrency.lockutils [None req-e262a27e-f0a4-4bc1-baa1-2ffbb6a4d965 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:16:19.769217 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG oslo_concurrency.lockutils [None req-a0a6687c-f853-4da0-b1c9-dfa49a32193a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:16:19.770046 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG oslo_concurrency.lockutils [None req-a0a6687c-f853-4da0-b1c9-dfa49a32193a None None] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:16:19.770439 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG oslo_concurrency.lockutils [None req-e262a27e-f0a4-4bc1-baa1-2ffbb6a4d965 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:16:19.771259 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG oslo_concurrency.lockutils [None req-e262a27e-f0a4-4bc1-baa1-2ffbb6a4d965 None None] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:16:19.772001 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG oslo_concurrency.lockutils [None req-a0a6687c-f853-4da0-b1c9-dfa49a32193a None None] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:16:19.773236 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG oslo_concurrency.lockutils [None req-e262a27e-f0a4-4bc1-baa1-2ffbb6a4d965 None None] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:16:19.782367 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG oslo_db.sqlalchemy.engines [None req-a0a6687c-f853-4da0-b1c9-dfa49a32193a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 03:16:19.785311 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG oslo_db.sqlalchemy.engines [None req-e262a27e-f0a4-4bc1-baa1-2ffbb6a4d965 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101883) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 03:16:19.788403 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG oslo_db.sqlalchemy.engines [None req-e262a27e-f0a4-4bc1-baa1-2ffbb6a4d965 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101883) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 03:16:19.791222 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG oslo_db.sqlalchemy.engines [None req-a0a6687c-f853-4da0-b1c9-dfa49a32193a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 03:16:20.046465 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG oslo_db.sqlalchemy.engines [None req-a0a6687c-f853-4da0-b1c9-dfa49a32193a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 03:16:20.049204 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG oslo_db.sqlalchemy.engines [None req-e262a27e-f0a4-4bc1-baa1-2ffbb6a4d965 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101883) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 03:16:20.388016 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: WARNING keystonemiddleware.auth_token [None req-a0a6687c-f853-4da0-b1c9-dfa49a32193a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 20 03:16:20.391900 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: WARNING keystonemiddleware.auth_token [None req-e262a27e-f0a4-4bc1-baa1-2ffbb6a4d965 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 20 03:16:20.394698 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: WARNING keystonemiddleware.auth_token [None req-a0a6687c-f853-4da0-b1c9-dfa49a32193a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 20 03:16:20.398305 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: WARNING keystonemiddleware.auth_token [None req-e262a27e-f0a4-4bc1-baa1-2ffbb6a4d965 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 20 03:16:20.622002 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: WARNING keystonemiddleware.auth_token [None req-a0a6687c-f853-4da0-b1c9-dfa49a32193a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 20 03:16:20.626992 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: WARNING keystonemiddleware.auth_token [None req-e262a27e-f0a4-4bc1-baa1-2ffbb6a4d965 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 20 03:16:20.627360 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: WARNING keystonemiddleware.auth_token [None req-a0a6687c-f853-4da0-b1c9-dfa49a32193a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 20 03:16:20.632161 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: WARNING keystonemiddleware.auth_token [None req-e262a27e-f0a4-4bc1-baa1-2ffbb6a4d965 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 20 03:16:20.632697 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558cfc8f19c0 pid: 101884 (default app) Nov 20 03:16:20.634795 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-a0a6687c-f853-4da0-b1c9-dfa49a32193a None None] Calling method '>' {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:16:20.636020 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-a0a6687c-f853-4da0-b1c9-dfa49a32193a None None] 10.222.0.37 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001738 Nov 20 03:16:20.636434 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 1/1] 10.222.0.37 () {50 vars in 788 bytes} [Sat Nov 20 03:16:20 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:16:20.637537 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558cfc8f19c0 pid: 101883 (default app) Nov 20 03:17:40.325920 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-a0a6687c-f853-4da0-b1c9-dfa49a32193a None None] Calling method '>' {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:17:40.326936 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-a0a6687c-f853-4da0-b1c9-dfa49a32193a None None] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Nov 20 03:17:40.327323 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 2/2] 10.222.0.37 () {54 vars in 930 bytes} [Sat Nov 20 03:17:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:17:40.867584 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-8fa9eaa6-a14d-4def-b702-00bc29753ec5 admin admin] Calling method '>' {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:17:40.899447 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-8fa9eaa6-a14d-4def-b702-00bc29753ec5 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.564166 Nov 20 03:17:40.900704 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 1/3] 10.222.0.37 () {60 vars in 1291 bytes} [Sat Nov 20 03:17:40 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:17:43.220531 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-a0a6687c-f853-4da0-b1c9-dfa49a32193a None None] Calling method '>' {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:17:43.222105 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-a0a6687c-f853-4da0-b1c9-dfa49a32193a None None] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001994 Nov 20 03:17:43.222966 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 3/4] 10.222.0.37 () {54 vars in 930 bytes} [Sat Nov 20 03:17:43 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:17:43.286840 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-8b304e2f-dc4f-48df-b139-f70095fd1adc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "swap": 0, "name": "cirros256", "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 256}} {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:17:43.306445 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:17:43.306445 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: warnings.warn(msg) Nov 20 03:17:43.334856 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-8b304e2f-dc4f-48df-b139-f70095fd1adc admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.104712 Nov 20 03:17:43.335436 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 2/5] 10.222.0.37 () {64 vars in 1282 bytes} [Sat Nov 20 03:17:43 2021] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:17:43.741512 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-ec62fb6f-4e44-4a6b-b12d-8254abcb14dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:17:43.743967 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:17:43.743967 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: warnings.warn(msg) Nov 20 03:17:43.789748 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-ec62fb6f-4e44-4a6b-b12d-8254abcb14dd admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.445529 Nov 20 03:17:43.791817 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 4/6] 10.222.0.37 () {64 vars in 1335 bytes} [Sat Nov 20 03:17:43 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:17:46.079740 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-8b304e2f-dc4f-48df-b139-f70095fd1adc admin admin] Calling method '>' {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:17:46.081343 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-8b304e2f-dc4f-48df-b139-f70095fd1adc admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002030 Nov 20 03:17:46.081934 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 3/7] 10.222.0.37 () {54 vars in 930 bytes} [Sat Nov 20 03:17:46 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:17:46.197308 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-cac885d3-7067-4268-aa19-4f169ac0477d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "name": "ds512M", "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:17:46.215116 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:17:46.215116 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: warnings.warn(msg) Nov 20 03:17:46.234884 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-cac885d3-7067-4268-aa19-4f169ac0477d admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.145033 Nov 20 03:17:46.242776 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 5/8] 10.222.0.37 () {64 vars in 1282 bytes} [Sat Nov 20 03:17:46 2021] POST /compute/v2.1/flavors => generated 404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:17:46.248641 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-522ffacd-5875-4b34-a564-d1207709ae17 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:17:46.250423 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:17:46.250423 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: warnings.warn(msg) Nov 20 03:17:46.292091 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-522ffacd-5875-4b34-a564-d1207709ae17 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046985 Nov 20 03:17:46.293031 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 4/9] 10.222.0.37 () {64 vars in 1335 bytes} [Sat Nov 20 03:17:46 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:17:48.618313 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-cac885d3-7067-4268-aa19-4f169ac0477d admin admin] Calling method '>' {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:17:48.619319 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-cac885d3-7067-4268-aa19-4f169ac0477d admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Nov 20 03:17:48.619893 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 6/10] 10.222.0.37 () {54 vars in 930 bytes} [Sat Nov 20 03:17:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:17:48.684245 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-5a7e10a0-67bf-4390-84e9-042b78f1e7f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 10, "rxtx_factor": 1.0, "name": "ds1G", "ram": 1024}} {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:17:48.703065 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-5a7e10a0-67bf-4390-84e9-042b78f1e7f3 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076574 Nov 20 03:17:48.703916 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 5/11] 10.222.0.37 () {64 vars in 1282 bytes} [Sat Nov 20 03:17:48 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:17:48.715817 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-88a728d5-73d5-40aa-ab7f-f5e5c6ee2e2b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:17:48.738362 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-88a728d5-73d5-40aa-ab7f-f5e5c6ee2e2b admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026093 Nov 20 03:17:48.744778 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 7/12] 10.222.0.37 () {64 vars in 1335 bytes} [Sat Nov 20 03:17:48 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:17:51.050713 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-5a7e10a0-67bf-4390-84e9-042b78f1e7f3 admin admin] Calling method '>' {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:17:51.051774 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-5a7e10a0-67bf-4390-84e9-042b78f1e7f3 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Nov 20 03:17:51.052213 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 6/13] 10.222.0.37 () {54 vars in 930 bytes} [Sat Nov 20 03:17:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:17:51.142269 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-dda45360-76ef-40b9-b364-f14712e7019a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d3", "ram": 2048, "disk": 10}} {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:17:51.160526 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-dda45360-76ef-40b9-b364-f14712e7019a admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.101828 Nov 20 03:17:51.161047 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 8/14] 10.222.0.37 () {64 vars in 1282 bytes} [Sat Nov 20 03:17:51 2021] POST /compute/v2.1/flavors => generated 404 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:17:51.173383 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-54d966c9-50f7-4722-8f43-6c69dfce04cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:17:51.195967 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-54d966c9-50f7-4722-8f43-6c69dfce04cf admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026354 Nov 20 03:17:51.196524 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 7/15] 10.222.0.37 () {64 vars in 1335 bytes} [Sat Nov 20 03:17:51 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:17:53.503522 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-dda45360-76ef-40b9-b364-f14712e7019a admin admin] Calling method '>' {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:17:53.504594 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-dda45360-76ef-40b9-b364-f14712e7019a admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Nov 20 03:17:53.504992 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 9/16] 10.222.0.37 () {54 vars in 930 bytes} [Sat Nov 20 03:17:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:17:53.570108 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-a2a08c6b-71b8-4a01-958f-ce753699ee7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0, "vcpus": 4, "id": "d4", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:17:53.590696 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-a2a08c6b-71b8-4a01-958f-ce753699ee7d admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079009 Nov 20 03:17:53.591468 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 8/17] 10.222.0.37 () {64 vars in 1282 bytes} [Sat Nov 20 03:17:53 2021] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 03:17:53.604433 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-a3d91817-8dce-499e-a7ae-dcee71ce8286 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:17:53.627885 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-a3d91817-8dce-499e-a7ae-dcee71ce8286 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027430 Nov 20 03:17:53.628597 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 10/18] 10.222.0.37 () {64 vars in 1335 bytes} [Sat Nov 20 03:17:53 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:17:55.967862 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-a2a08c6b-71b8-4a01-958f-ce753699ee7d admin admin] Calling method '>' {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:17:55.968871 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-a2a08c6b-71b8-4a01-958f-ce753699ee7d admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Nov 20 03:17:55.969270 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 9/19] 10.222.0.37 () {54 vars in 930 bytes} [Sat Nov 20 03:17:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:17:56.034582 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-f6f14d82-c93a-42d5-bca5-5f8a6f1d8978 admin admin] Calling method '>' {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:17:56.059354 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-f6f14d82-c93a-42d5-bca5-5f8a6f1d8978 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083723 Nov 20 03:17:56.059938 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 11/20] 10.222.0.37 () {60 vars in 1291 bytes} [Sat Nov 20 03:17:55 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:17:58.326030 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-a2a08c6b-71b8-4a01-958f-ce753699ee7d admin admin] Calling method '>' {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:17:58.327680 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-a2a08c6b-71b8-4a01-958f-ce753699ee7d admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002384 Nov 20 03:17:58.328393 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 10/21] 10.222.0.37 () {54 vars in 930 bytes} [Sat Nov 20 03:17:58 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:17:58.407752 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-b49f282c-e66c-486f-b5a4-6aa62afd0d6c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "disk": 1, "name": "m1.tiny", "swap": 0, "id": "1", "vcpus": 1}} {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:17:58.429579 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-b49f282c-e66c-486f-b5a4-6aa62afd0d6c admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.094795 Nov 20 03:17:58.430311 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 12/22] 10.222.0.37 () {64 vars in 1282 bytes} [Sat Nov 20 03:17:58 2021] POST /compute/v2.1/flavors => generated 402 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 03:17:58.446254 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-7e7342df-4cb8-4d42-8733-0176d47b86ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:17:58.475982 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-7e7342df-4cb8-4d42-8733-0176d47b86ca admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036316 Nov 20 03:17:58.476553 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 11/23] 10.222.0.37 () {64 vars in 1332 bytes} [Sat Nov 20 03:17:58 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:18:00.756401 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-b49f282c-e66c-486f-b5a4-6aa62afd0d6c admin admin] Calling method '>' {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:18:00.757411 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-b49f282c-e66c-486f-b5a4-6aa62afd0d6c admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Nov 20 03:18:00.757822 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 13/24] 10.222.0.37 () {54 vars in 930 bytes} [Sat Nov 20 03:18:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:18:00.828744 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-b29e0157-f834-4863-ba7e-9016ede1ca1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "vcpus": 1, "id": "2", "swap": 0, "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:18:00.846489 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-b29e0157-f834-4863-ba7e-9016ede1ca1b admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082243 Nov 20 03:18:00.847421 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 12/25] 10.222.0.37 () {64 vars in 1282 bytes} [Sat Nov 20 03:18:00 2021] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 03:18:00.861807 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-1ab14edc-c5c0-4a20-ad79-cccebebbfd46 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:18:00.887305 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-1ab14edc-c5c0-4a20-ad79-cccebebbfd46 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030094 Nov 20 03:18:00.887857 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 14/26] 10.222.0.37 () {64 vars in 1332 bytes} [Sat Nov 20 03:18:00 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:18:03.158800 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-b29e0157-f834-4863-ba7e-9016ede1ca1b admin admin] Calling method '>' {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:18:03.159906 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-b29e0157-f834-4863-ba7e-9016ede1ca1b admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Nov 20 03:18:03.160896 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 13/27] 10.222.0.37 () {54 vars in 930 bytes} [Sat Nov 20 03:18:03 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:18:03.218926 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-3b3dc3e1-56ee-4578-8a16-d1153a209c63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 40, "ram": 4096, "swap": 0, "vcpus": 2, "name": "m1.medium", "id": "3"}} {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:18:03.238291 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-3b3dc3e1-56ee-4578-8a16-d1153a209c63 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070939 Nov 20 03:18:03.238871 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 15/28] 10.222.0.37 () {64 vars in 1282 bytes} [Sat Nov 20 03:18:03 2021] POST /compute/v2.1/flavors => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:18:03.250958 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-bf2f6a60-ac4f-42ed-b06b-f436b66e6c39 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:18:03.273443 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-bf2f6a60-ac4f-42ed-b06b-f436b66e6c39 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026158 Nov 20 03:18:03.274004 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 14/29] 10.222.0.37 () {64 vars in 1332 bytes} [Sat Nov 20 03:18:03 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:18:05.657471 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-3b3dc3e1-56ee-4578-8a16-d1153a209c63 admin admin] Calling method '>' {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:18:05.658501 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-3b3dc3e1-56ee-4578-8a16-d1153a209c63 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Nov 20 03:18:05.658899 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 16/30] 10.222.0.37 () {54 vars in 930 bytes} [Sat Nov 20 03:18:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:18:05.720051 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-4cb4e78c-3b04-48bc-bb02-b1ab0f9ecb07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "id": "4", "rxtx_factor": 1.0, "vcpus": 4, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192, "swap": 0}} {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:18:05.739810 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-4cb4e78c-3b04-48bc-bb02-b1ab0f9ecb07 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074458 Nov 20 03:18:05.740364 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 15/31] 10.222.0.37 () {64 vars in 1282 bytes} [Sat Nov 20 03:18:05 2021] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 03:18:05.752650 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-1ab39e11-3759-4db2-858d-df08d7a77fec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:18:05.776645 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-1ab39e11-3759-4db2-858d-df08d7a77fec admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027783 Nov 20 03:18:05.777230 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 17/32] 10.222.0.37 () {64 vars in 1332 bytes} [Sat Nov 20 03:18:05 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:18:08.098202 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-4cb4e78c-3b04-48bc-bb02-b1ab0f9ecb07 admin admin] Calling method '>' {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:18:08.099893 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-4cb4e78c-3b04-48bc-bb02-b1ab0f9ecb07 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002608 Nov 20 03:18:08.100958 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 16/33] 10.222.0.37 () {54 vars in 930 bytes} [Sat Nov 20 03:18:08 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:18:08.162445 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-ecec20df-574e-4855-af59-4cb474020575 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "disk": 160, "rxtx_factor": 1.0, "id": "5", "name": "m1.xlarge", "vcpus": 8, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:18:08.182343 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-ecec20df-574e-4855-af59-4cb474020575 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.074069 Nov 20 03:18:08.182914 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 18/34] 10.222.0.37 () {64 vars in 1282 bytes} [Sat Nov 20 03:18:08 2021] POST /compute/v2.1/flavors => generated 408 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:18:08.195432 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-682f99a2-da28-45c7-8831-a1a1bacaaca3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:18:08.221532 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-682f99a2-da28-45c7-8831-a1a1bacaaca3 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030115 Nov 20 03:18:08.222205 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 17/35] 10.222.0.37 () {64 vars in 1332 bytes} [Sat Nov 20 03:18:08 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:18:30.132027 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-ecec20df-574e-4855-af59-4cb474020575 admin admin] Calling method '>' {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:18:30.133066 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-ecec20df-574e-4855-af59-4cb474020575 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Nov 20 03:18:30.133472 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 19/36] 10.222.0.37 () {54 vars in 930 bytes} [Sat Nov 20 03:18:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:18:30.190740 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-361bfb3e-8040-4c1e-ae61-a2bc4969bf9d admin admin] Calling method '>' {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:18:30.207571 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-361bfb3e-8040-4c1e-ae61-a2bc4969bf9d admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067496 Nov 20 03:18:30.208124 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 18/37] 10.222.0.37 () {60 vars in 1291 bytes} [Sat Nov 20 03:18:30 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:18:31.687664 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-ecec20df-574e-4855-af59-4cb474020575 admin admin] Calling method '>' {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:18:31.688702 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-ecec20df-574e-4855-af59-4cb474020575 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Nov 20 03:18:31.689116 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 20/38] 10.222.0.37 () {56 vars in 1074 bytes} [Sat Nov 20 03:18:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:18:31.879968 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-0bd85dac-55fd-4942-8329-f94a49244c78 admin admin] Calling method '>' {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:18:31.885460 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.wsgi [None req-0bd85dac-55fd-4942-8329-f94a49244c78 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 20 03:18:31.886038 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-0bd85dac-55fd-4942-8329-f94a49244c78 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:18:31.886880 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-0bd85dac-55fd-4942-8329-f94a49244c78 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057753 Nov 20 03:18:31.887401 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 19/39] 10.222.0.37 () {60 vars in 1190 bytes} [Sat Nov 20 03:18:31 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 20 03:18:31.898001 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-67eca593-4c65-438d-b38d-72775a93ea57 admin admin] Calling method '>' {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:18:31.918676 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-67eca593-4c65-438d-b38d-72775a93ea57 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025010 Nov 20 03:18:31.919224 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 21/40] 10.222.0.37 () {60 vars in 1210 bytes} [Sat Nov 20 03:18:31 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:18:31.929385 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-7953a6dd-e4eb-4aa5-afcb-3977e622e777 admin admin] Calling method '>' {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:18:31.949868 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-7953a6dd-e4eb-4aa5-afcb-3977e622e777 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023988 Nov 20 03:18:31.950388 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 20/41] 10.222.0.37 () {60 vars in 1210 bytes} [Sat Nov 20 03:18:31 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:18:31.960558 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-9fdae912-a773-4c31-8dfe-aa5f41728633 admin admin] Calling method '>' {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:18:31.965866 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.wsgi [None req-9fdae912-a773-4c31-8dfe-aa5f41728633 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 20 03:18:31.966433 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-9fdae912-a773-4c31-8dfe-aa5f41728633 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:18:31.967216 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-9fdae912-a773-4c31-8dfe-aa5f41728633 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010770 Nov 20 03:18:31.967701 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 22/42] 10.222.0.37 () {60 vars in 1190 bytes} [Sat Nov 20 03:18:31 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 20 03:18:33.344999 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-7953a6dd-e4eb-4aa5-afcb-3977e622e777 admin admin] Calling method '>' {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:18:33.346034 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-7953a6dd-e4eb-4aa5-afcb-3977e622e777 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Nov 20 03:18:33.346428 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 21/43] 10.222.0.37 () {56 vars in 1074 bytes} [Sat Nov 20 03:18:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:18:33.536372 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-df2d727d-b19b-4306-96b9-3704a4b6141c admin admin] Calling method '>' {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:18:33.542019 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.wsgi [None req-df2d727d-b19b-4306-96b9-3704a4b6141c admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 20 03:18:33.542586 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-df2d727d-b19b-4306-96b9-3704a4b6141c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:18:33.543375 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-df2d727d-b19b-4306-96b9-3704a4b6141c admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058706 Nov 20 03:18:33.543904 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 23/44] 10.222.0.37 () {60 vars in 1190 bytes} [Sat Nov 20 03:18:33 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 20 03:18:33.554207 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-3587e4d5-f3f6-4e5a-9b2f-1b2a482451b3 admin admin] Calling method '>' {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:18:33.567973 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-3587e4d5-f3f6-4e5a-9b2f-1b2a482451b3 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017844 Nov 20 03:18:33.568496 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 22/45] 10.222.0.37 () {60 vars in 1210 bytes} [Sat Nov 20 03:18:33 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:18:33.578185 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-593e694c-df6d-4d17-ae9a-9cd30482cd2d admin admin] Calling method '>' {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:18:33.591337 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-593e694c-df6d-4d17-ae9a-9cd30482cd2d admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016558 Nov 20 03:18:33.591878 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 24/46] 10.222.0.37 () {60 vars in 1210 bytes} [Sat Nov 20 03:18:33 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:18:33.602066 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-d0bb67d8-650c-4be5-acd5-a22a972eb87f admin admin] Calling method '>' {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:18:33.607124 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.wsgi [None req-d0bb67d8-650c-4be5-acd5-a22a972eb87f admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 20 03:18:33.607680 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-d0bb67d8-650c-4be5-acd5-a22a972eb87f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:18:33.608492 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-d0bb67d8-650c-4be5-acd5-a22a972eb87f admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010192 Nov 20 03:18:33.608975 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 23/47] 10.222.0.37 () {60 vars in 1190 bytes} [Sat Nov 20 03:18:33 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 20 03:18:34.970962 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-593e694c-df6d-4d17-ae9a-9cd30482cd2d admin admin] Calling method '>' {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:18:34.972616 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-593e694c-df6d-4d17-ae9a-9cd30482cd2d admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Nov 20 03:18:34.973012 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 25/48] 10.222.0.37 () {56 vars in 1074 bytes} [Sat Nov 20 03:18:34 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:18:35.159356 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-bd3fa16b-ed00-4933-9ec3-a1fe7820f97b admin admin] Calling method '>' {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:18:35.164582 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.wsgi [None req-bd3fa16b-ed00-4933-9ec3-a1fe7820f97b admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 20 03:18:35.165136 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-bd3fa16b-ed00-4933-9ec3-a1fe7820f97b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:18:35.165917 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-bd3fa16b-ed00-4933-9ec3-a1fe7820f97b admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057309 Nov 20 03:18:35.166408 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 24/49] 10.222.0.37 () {60 vars in 1193 bytes} [Sat Nov 20 03:18:35 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 20 03:18:35.175891 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-4f92f176-1cd6-432a-825e-6023d83cc541 admin admin] Calling method '>' {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:18:35.188923 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-4f92f176-1cd6-432a-825e-6023d83cc541 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016431 Nov 20 03:18:35.189376 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 26/50] 10.222.0.37 () {60 vars in 1210 bytes} [Sat Nov 20 03:18:35 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:18:35.199667 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-9f157dab-9941-46ba-a73a-de728aa16382 admin admin] Calling method '>' {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:18:35.212909 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-9f157dab-9941-46ba-a73a-de728aa16382 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017038 Nov 20 03:18:35.213457 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 25/51] 10.222.0.37 () {60 vars in 1210 bytes} [Sat Nov 20 03:18:35 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:18:35.222919 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-bb0b97d8-4969-4625-ab85-7b73556a22da admin admin] Calling method '>' {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:18:35.228211 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.wsgi [None req-bb0b97d8-4969-4625-ab85-7b73556a22da admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 20 03:18:35.228773 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-bb0b97d8-4969-4625-ab85-7b73556a22da admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:18:35.229555 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-bb0b97d8-4969-4625-ab85-7b73556a22da admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010069 Nov 20 03:18:35.230043 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 27/52] 10.222.0.37 () {60 vars in 1193 bytes} [Sat Nov 20 03:18:35 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 20 03:18:36.605087 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-9f157dab-9941-46ba-a73a-de728aa16382 admin admin] Calling method '>' {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:18:36.606103 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-9f157dab-9941-46ba-a73a-de728aa16382 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Nov 20 03:18:36.606501 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 26/53] 10.222.0.37 () {56 vars in 1074 bytes} [Sat Nov 20 03:18:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:18:36.801504 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-b83d7c29-743a-4115-b5da-ecf34e7dab34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:18:36.818917 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-b83d7c29-743a-4115-b5da-ecf34e7dab34 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069183 Nov 20 03:18:36.819385 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 28/54] 10.222.0.37 () {64 vars in 1235 bytes} [Sat Nov 20 03:18:36 2021] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:18:38.190631 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-9f157dab-9941-46ba-a73a-de728aa16382 admin admin] Calling method '>' {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:18:38.191707 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-9f157dab-9941-46ba-a73a-de728aa16382 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Nov 20 03:18:38.192144 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 27/55] 10.222.0.37 () {56 vars in 1074 bytes} [Sat Nov 20 03:18:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:18:38.381878 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-2e3f24e5-7152-4595-a46f-27e3baa1916e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:18:38.399426 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-2e3f24e5-7152-4595-a46f-27e3baa1916e admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068417 Nov 20 03:18:38.400028 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 29/56] 10.222.0.37 () {64 vars in 1235 bytes} [Sat Nov 20 03:18:38 2021] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:18:39.787069 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-9f157dab-9941-46ba-a73a-de728aa16382 admin admin] Calling method '>' {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:18:39.788113 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-9f157dab-9941-46ba-a73a-de728aa16382 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Nov 20 03:18:39.788517 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 28/57] 10.222.0.37 () {56 vars in 1074 bytes} [Sat Nov 20 03:18:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:18:39.980751 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-6e0467fd-0d6d-4fbf-a8f2-1076aad0631b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:18:39.998442 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-6e0467fd-0d6d-4fbf-a8f2-1076aad0631b admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068761 Nov 20 03:18:39.998941 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 30/58] 10.222.0.37 () {64 vars in 1235 bytes} [Sat Nov 20 03:18:39 2021] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:18:41.380312 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-9f157dab-9941-46ba-a73a-de728aa16382 admin admin] Calling method '>' {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:18:41.381342 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-9f157dab-9941-46ba-a73a-de728aa16382 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Nov 20 03:18:41.381736 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 29/59] 10.222.0.37 () {56 vars in 1074 bytes} [Sat Nov 20 03:18:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:18:41.574750 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-e332a079-e3d4-4fb2-a33d-daa3774247fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:18:41.594941 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-e332a079-e3d4-4fb2-a33d-daa3774247fe admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070916 Nov 20 03:18:41.595408 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 31/60] 10.222.0.37 () {64 vars in 1235 bytes} [Sat Nov 20 03:18:41 2021] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:18:42.991255 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-9f157dab-9941-46ba-a73a-de728aa16382 admin admin] Calling method '>' {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:18:42.992318 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-9f157dab-9941-46ba-a73a-de728aa16382 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Nov 20 03:18:42.992718 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 30/61] 10.222.0.37 () {56 vars in 1074 bytes} [Sat Nov 20 03:18:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:18:43.181130 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-3e91a76d-2eef-47d4-a5f1-39a51c2261f0 admin admin] Calling method '>' {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:18:43.200462 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-3e91a76d-2eef-47d4-a5f1-39a51c2261f0 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069866 Nov 20 03:18:43.200999 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 32/62] 10.222.0.37 () {60 vars in 1202 bytes} [Sat Nov 20 03:18:43 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:19:30.499260 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-9f157dab-9941-46ba-a73a-de728aa16382 admin admin] Calling method '>' {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:19:30.500291 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-9f157dab-9941-46ba-a73a-de728aa16382 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Nov 20 03:19:30.500717 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 31/63] 10.222.0.37 () {54 vars in 930 bytes} [Sat Nov 20 03:19:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:19:30.558175 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-a7bbe354-8d82-4555-8d35-b5b84a984980 admin admin] Calling method '>' {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:19:30.577322 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-a7bbe354-8d82-4555-8d35-b5b84a984980 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070014 Nov 20 03:19:30.577850 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 33/64] 10.222.0.37 () {60 vars in 1291 bytes} [Sat Nov 20 03:19:30 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:19:30.600048 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-1e1cb329-3df6-4143-a819-736b6d401f1c admin admin] Calling method '>' {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:19:30.607954 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-1e1cb329-3df6-4143-a819-736b6d401f1c admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011376 Nov 20 03:19:30.608466 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 32/65] 10.222.0.37 () {60 vars in 1282 bytes} [Sat Nov 20 03:19:30 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:19:30.620093 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-a602d18c-17f7-4b89-9152-55a5034a672d admin admin] Calling method '>' {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:19:30.628127 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-a602d18c-17f7-4b89-9152-55a5034a672d admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011664 Nov 20 03:19:30.628699 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 34/66] 10.222.0.37 () {60 vars in 1285 bytes} [Sat Nov 20 03:19:30 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:19:30.640582 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-5436284e-687f-41c7-b795-0044d60e1466 admin admin] Calling method '>' {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:19:30.648862 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-5436284e-687f-41c7-b795-0044d60e1466 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011842 Nov 20 03:19:30.649379 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 33/67] 10.222.0.37 () {60 vars in 1285 bytes} [Sat Nov 20 03:19:30 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:19:30.660978 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-4dec176a-7c13-44d1-87a0-fe4364425558 admin admin] Calling method '>' {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:19:30.669876 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-4dec176a-7c13-44d1-87a0-fe4364425558 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012383 Nov 20 03:19:30.670412 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 35/68] 10.222.0.37 () {60 vars in 1282 bytes} [Sat Nov 20 03:19:30 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:20:58.281600 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-efa9025c-c89a-4e11-8740-a0f40bbadf29 tempest-verify_tempest_config-572172760 tempest-verify_tempest_config-572172760-project] Calling method '>' {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:20:58.283617 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-efa9025c-c89a-4e11-8740-a0f40bbadf29 tempest-verify_tempest_config-572172760 tempest-verify_tempest_config-572172760-project] 10.222.0.37 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.108495 Nov 20 03:20:58.284186 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 34/69] 10.222.0.37 () {58 vars in 1133 bytes} [Sat Nov 20 03:20:58 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:22:23.973491 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-4dec176a-7c13-44d1-87a0-fe4364425558 admin admin] Calling method '>' {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:22:23.974622 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-4dec176a-7c13-44d1-87a0-fe4364425558 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Nov 20 03:22:23.975024 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 36/70] 10.222.0.37 () {56 vars in 1074 bytes} [Sat Nov 20 03:22:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:22:24.227970 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-7a5697ef-a453-4a65-b675-bfb377ded204 admin admin] Calling method '>' {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:22:24.229126 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:22:24.229126 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: warnings.warn(msg) Nov 20 03:22:24.230662 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG oslo_concurrency.lockutils [None req-7a5697ef-a453-4a65-b675-bfb377ded204 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:22:24.231111 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG oslo_concurrency.lockutils [None req-7a5697ef-a453-4a65-b675-bfb377ded204 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:22:24.231951 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG oslo_concurrency.lockutils [None req-7a5697ef-a453-4a65-b675-bfb377ded204 admin admin] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:22:24.232381 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG oslo_concurrency.lockutils [None req-7a5697ef-a453-4a65-b675-bfb377ded204 admin admin] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:22:24.265725 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-7a5697ef-a453-4a65-b675-bfb377ded204 admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.150635 Nov 20 03:22:24.266266 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 35/71] 10.222.0.37 () {60 vars in 1193 bytes} [Sat Nov 20 03:22:24 2021] GET /compute/v2.1/os-services => generated 791 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:22:25.662362 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-4dec176a-7c13-44d1-87a0-fe4364425558 admin admin] Calling method '>' {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:22:25.663369 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-4dec176a-7c13-44d1-87a0-fe4364425558 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Nov 20 03:22:25.663770 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 37/72] 10.222.0.37 () {56 vars in 1074 bytes} [Sat Nov 20 03:22:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:22:25.858166 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-0c1511b3-d668-4b04-80c1-44245efb74c0 admin admin] Calling method '>' {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:22:25.859353 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:22:25.859353 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: warnings.warn(msg) Nov 20 03:22:25.860988 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG oslo_concurrency.lockutils [None req-0c1511b3-d668-4b04-80c1-44245efb74c0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:22:25.861435 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG oslo_concurrency.lockutils [None req-0c1511b3-d668-4b04-80c1-44245efb74c0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:22:25.862230 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG oslo_concurrency.lockutils [None req-0c1511b3-d668-4b04-80c1-44245efb74c0 admin admin] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:22:25.862660 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG oslo_concurrency.lockutils [None req-0c1511b3-d668-4b04-80c1-44245efb74c0 admin admin] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:22:25.881465 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-0c1511b3-d668-4b04-80c1-44245efb74c0 admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074521 Nov 20 03:22:25.882024 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 36/73] 10.222.0.37 () {60 vars in 1193 bytes} [Sat Nov 20 03:22:25 2021] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:22:37.713661 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-4dec176a-7c13-44d1-87a0-fe4364425558 admin admin] Calling method '>' {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:22:37.714664 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-4dec176a-7c13-44d1-87a0-fe4364425558 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Nov 20 03:22:37.715060 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 38/74] 10.222.0.37 () {56 vars in 1074 bytes} [Sat Nov 20 03:22:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:22:37.904769 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-4b71197f-083d-4123-a522-72df96a525ee admin admin] Calling method '>' {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:22:37.905943 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:22:37.905943 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: warnings.warn(msg) Nov 20 03:22:37.907444 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG oslo_concurrency.lockutils [None req-4b71197f-083d-4123-a522-72df96a525ee admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:22:37.908475 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG oslo_concurrency.lockutils [None req-4b71197f-083d-4123-a522-72df96a525ee admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:22:37.909290 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG oslo_concurrency.lockutils [None req-4b71197f-083d-4123-a522-72df96a525ee admin admin] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:22:37.909739 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG oslo_concurrency.lockutils [None req-4b71197f-083d-4123-a522-72df96a525ee admin admin] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:22:37.933059 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-4b71197f-083d-4123-a522-72df96a525ee admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078747 Nov 20 03:22:37.933528 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 37/75] 10.222.0.37 () {60 vars in 1193 bytes} [Sat Nov 20 03:22:37 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:22:39.323925 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: DEBUG nova.api.openstack.wsgi [None req-4dec176a-7c13-44d1-87a0-fe4364425558 admin admin] Calling method '>' {{(pid=101884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:22:39.324930 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: INFO nova.api.openstack.requestlog [None req-4dec176a-7c13-44d1-87a0-fe4364425558 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Nov 20 03:22:39.325324 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: [pid: 101884|app: 0|req: 39/76] 10.222.0.37 () {56 vars in 1074 bytes} [Sat Nov 20 03:22:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:22:39.521269 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG nova.api.openstack.wsgi [None req-68916a8b-5ee8-4259-866b-1257641d4b60 admin admin] Calling method '>' {{(pid=101883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:22:39.522468 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:22:39.522468 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: warnings.warn(msg) Nov 20 03:22:39.524086 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG oslo_concurrency.lockutils [None req-68916a8b-5ee8-4259-866b-1257641d4b60 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:22:39.524557 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG oslo_concurrency.lockutils [None req-68916a8b-5ee8-4259-866b-1257641d4b60 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:22:39.525362 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG oslo_concurrency.lockutils [None req-68916a8b-5ee8-4259-866b-1257641d4b60 admin admin] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:22:39.525793 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: DEBUG oslo_concurrency.lockutils [None req-68916a8b-5ee8-4259-866b-1257641d4b60 admin admin] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:22:39.547840 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: INFO nova.api.openstack.requestlog [None req-68916a8b-5ee8-4259-866b-1257641d4b60 admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079038 Nov 20 03:22:39.548445 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: [pid: 101883|app: 0|req: 38/77] 10.222.0.37 () {60 vars in 1193 bytes} [Sat Nov 20 03:22:39 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:23:34.986898 dv-cinder-818037-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 20 03:23:34.987756 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: Sat Nov 20 03:23:34 2021 - graceful shutdown triggered... Nov 20 03:23:34.988267 dv-cinder-818037-5-iscsi devstack@n-api.service[101884]: Gracefully killing worker 2 (pid: 101884)... Nov 20 03:23:34.988631 dv-cinder-818037-5-iscsi devstack@n-api.service[101883]: Gracefully killing worker 1 (pid: 101883)... Nov 20 03:23:35.988089 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: worker 1 buried after 1 seconds Nov 20 03:23:35.988089 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: worker 2 buried after 1 seconds Nov 20 03:23:35.988089 dv-cinder-818037-5-iscsi devstack@n-api.service[101882]: goodbye to uWSGI. Nov 20 03:23:35.989593 dv-cinder-818037-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 20 03:23:35.990139 dv-cinder-818037-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 20 03:23:35.992989 dv-cinder-818037-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 20 03:23:36.004217 dv-cinder-818037-5-iscsi devstack@n-api.service[116098]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 20 03:23:36.006830 dv-cinder-818037-5-iscsi devstack@n-api.service[116098]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Nov 20 03:23:36 2021] *** Nov 20 03:23:36.006830 dv-cinder-818037-5-iscsi devstack@n-api.service[116098]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 20 03:23:36.006830 dv-cinder-818037-5-iscsi devstack@n-api.service[116098]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 20 03:23:36.006830 dv-cinder-818037-5-iscsi devstack@n-api.service[116098]: nodename: dv-cinder-818037-5-iscsi Nov 20 03:23:36.006830 dv-cinder-818037-5-iscsi devstack@n-api.service[116098]: machine: x86_64 Nov 20 03:23:36.006830 dv-cinder-818037-5-iscsi devstack@n-api.service[116098]: clock source: unix Nov 20 03:23:36.006830 dv-cinder-818037-5-iscsi devstack@n-api.service[116098]: pcre jit disabled Nov 20 03:23:36.006830 dv-cinder-818037-5-iscsi devstack@n-api.service[116098]: detected number of CPU cores: 4 Nov 20 03:23:36.006830 dv-cinder-818037-5-iscsi devstack@n-api.service[116098]: current working directory: / Nov 20 03:23:36.006830 dv-cinder-818037-5-iscsi devstack@n-api.service[116098]: detected binary path: /usr/bin/uwsgi-core Nov 20 03:23:36.007498 dv-cinder-818037-5-iscsi devstack@n-api.service[116098]: your processes number limit is 47680 Nov 20 03:23:36.007498 dv-cinder-818037-5-iscsi devstack@n-api.service[116098]: your memory page size is 4096 bytes Nov 20 03:23:36.007498 dv-cinder-818037-5-iscsi devstack@n-api.service[116098]: detected max file descriptor number: 2048 Nov 20 03:23:36.007498 dv-cinder-818037-5-iscsi devstack@n-api.service[116098]: lock engine: pthread robust mutexes Nov 20 03:23:36.007498 dv-cinder-818037-5-iscsi devstack@n-api.service[116098]: thunder lock: enabled Nov 20 03:23:36.007498 dv-cinder-818037-5-iscsi devstack@n-api.service[116098]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 20 03:23:36.007498 dv-cinder-818037-5-iscsi devstack@n-api.service[116098]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 20 03:23:36.052400 dv-cinder-818037-5-iscsi devstack@n-api.service[116098]: Python main interpreter initialized at 0x5643670e19c0 Nov 20 03:23:36.052400 dv-cinder-818037-5-iscsi devstack@n-api.service[116098]: python threads support enabled Nov 20 03:23:36.052400 dv-cinder-818037-5-iscsi devstack@n-api.service[116098]: your server socket listen backlog is limited to 100 connections Nov 20 03:23:36.052400 dv-cinder-818037-5-iscsi devstack@n-api.service[116098]: your mercy for graceful operations on workers is 90 seconds Nov 20 03:23:36.052843 dv-cinder-818037-5-iscsi devstack@n-api.service[116098]: mapped 403077 bytes (393 KB) for 2 cores Nov 20 03:23:36.052843 dv-cinder-818037-5-iscsi devstack@n-api.service[116098]: *** Operational MODE: preforking *** Nov 20 03:23:36.053137 dv-cinder-818037-5-iscsi devstack@n-api.service[116098]: *** uWSGI is running in multiple interpreter mode *** Nov 20 03:23:36.053137 dv-cinder-818037-5-iscsi devstack@n-api.service[116098]: spawned uWSGI master process (pid: 116098) Nov 20 03:23:36.053337 dv-cinder-818037-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 20 03:23:36.054916 dv-cinder-818037-5-iscsi devstack@n-api.service[116098]: spawned uWSGI worker 1 (pid: 116113, cores: 1) Nov 20 03:23:36.054916 dv-cinder-818037-5-iscsi devstack@n-api.service[116098]: spawned uWSGI worker 2 (pid: 116114, cores: 1) Nov 20 03:23:36.054916 dv-cinder-818037-5-iscsi devstack@n-api.service[116098]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 20 03:23:37.821971 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 20 03:23:37.821971 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: from cryptography.utils import int_from_bytes Nov 20 03:23:37.822777 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 20 03:23:37.822777 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: from cryptography.utils import int_from_bytes Nov 20 03:23:37.825082 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 20 03:23:37.825082 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: from cryptography.utils import int_from_bytes Nov 20 03:23:37.825650 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 20 03:23:37.825650 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: from cryptography.utils import int_from_bytes Nov 20 03:23:40.156787 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 20 03:23:40.157369 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 20 03:23:40.157477 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 20 03:23:40.157791 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 20 03:23:40.158041 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 20 03:23:40.158432 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.158755 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.159092 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.159400 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.159730 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.160081 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.160406 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.160726 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.161052 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.161312 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.161630 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.161953 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-5-iscsi {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.162281 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.162592 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.162905 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.163223 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.163527 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.163873 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.164195 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.164692 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.167078 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.167078 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.167078 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.167078 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.167078 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.167078 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.167078 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.167546 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.167546 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.167906 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.168297 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-5-iscsi {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.168628 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.168942 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.169248 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.169662 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.169987 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.170249 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 20 03:23:40.170650 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.170751 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 20 03:23:40.170833 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.170914 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.171139 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 20 03:23:40.171368 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.171584 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 20 03:23:40.171835 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.172543 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 20 03:23:40.172769 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.172992 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.173207 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.173422 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.173641 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.173860 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.174082 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.174298 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.174516 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.174731 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.174907 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.175147 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.175336 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.175490 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.175651 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.175651 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.176017 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.176177 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.176327 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.176513 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.176699 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.176851 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.177004 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.177167 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.178490 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-5-iscsi {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.178602 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.178696 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.178772 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.178858 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.178933 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.179004 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.179102 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.179189 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.179261 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.179344 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.179427 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.179505 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.179587 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.179659 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.179734 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.179734 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.179928 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.180023 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.180096 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.180172 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.180264 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.180348 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.180425 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.180497 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.180599 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.180676 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.180759 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.180843 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.180924 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.180996 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.181064 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.181141 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.181221 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.181319 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.181519 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.181618 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.181876 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.181974 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.182162 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.182257 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-5-iscsi {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.182445 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.182556 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.182767 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.182880 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.183076 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.183170 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.183397 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.183500 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.183719 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.183851 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.184055 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.184154 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.184365 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.184473 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.184672 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.184771 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.184991 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.185090 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.185324 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.185422 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.185632 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.185730 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.185883 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.186005 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.186186 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.186398 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.186542 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.186673 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.186802 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.186932 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.187091 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.187241 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.187381 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.187617 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.188275 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.188445 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.188589 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.188740 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.188872 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.189011 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.189141 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.189280 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.189438 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.189603 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.189819 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.189949 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.190048 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.190220 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.190343 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.190480 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.190625 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.190724 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.190931 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.191052 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.191237 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.191381 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.191555 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.191698 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.191895 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.192040 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.192203 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.192354 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.192515 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.192670 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.192820 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.192986 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.193125 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.193302 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.193446 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.193616 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.193753 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.193930 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.194057 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.194254 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.194377 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.194579 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.194671 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.194907 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.195006 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.195222 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.195324 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.195550 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.195650 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.195878 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.195988 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.196197 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.196291 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.196497 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.196598 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.196804 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.196903 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.197121 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.197221 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.197428 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.197578 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.197733 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.197876 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.198034 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.198167 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.198327 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.198469 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.198629 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.198774 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.198935 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.199078 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.199237 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.199383 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.199530 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.199765 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.199949 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.200146 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.200288 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.200429 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.200568 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.200713 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.200846 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.200985 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.201116 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.201253 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.201383 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.201530 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.201668 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.201807 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.201939 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.202076 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.202312 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.202476 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.202610 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.202749 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.202879 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.203000 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.203210 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.203344 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.203525 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.203657 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.203867 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.204011 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.204181 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.204302 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.204493 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.204618 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.204803 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.204949 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.205114 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.205244 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.205475 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.205613 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.205736 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.205862 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.206043 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.206170 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.206362 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.206484 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.206647 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.206767 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.206960 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.207083 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.207263 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.207376 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.207582 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.207709 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.207916 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.208047 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.208234 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.208373 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.208552 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.208677 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.208869 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.209013 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.209178 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.209296 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.209497 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.209648 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.209878 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.210025 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.210180 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.210371 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.210507 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.210648 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.210806 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.210946 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.211088 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.211229 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.211362 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.211486 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.211635 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.211778 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.211968 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.212096 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.212318 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.212473 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.212615 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.212756 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.212896 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.213028 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.213169 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.213299 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.213496 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.213658 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.213801 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.213947 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.214064 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.214204 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.214385 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.214534 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.214672 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.214795 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.214990 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.215128 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.215288 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.215433 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.215609 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.215754 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 03:23:40.215960 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.216096 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.216270 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.216406 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.216603 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.216749 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.216909 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.217044 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.217221 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.217356 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.217531 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.217667 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.217834 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.217976 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.218146 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.218289 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.218458 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.218593 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.219277 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.219424 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.219608 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.219746 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.220015 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.220158 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.220297 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.220457 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.220600 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.220733 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.220863 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.220993 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.221122 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.221251 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.221416 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.221558 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.221729 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.221865 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.222039 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.222189 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.222350 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.222485 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.222671 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.222807 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.222985 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.223131 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.223296 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.223431 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.223627 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.223781 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.223992 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.224136 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.224298 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.224444 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.224876 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.225025 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.225210 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.225346 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.225524 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.225665 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.225827 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.225975 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.226138 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.226273 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.226441 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.226575 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.226747 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.226881 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.227051 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.227195 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.227361 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.227504 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.227666 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.227844 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.227991 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.228125 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.228285 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.228419 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.228589 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.228738 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.228892 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.229026 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.229212 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.229354 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.229523 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.229677 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.229810 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.229965 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.230165 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.230297 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.230425 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.230563 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.230735 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.230876 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.231042 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.231176 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.231381 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.231521 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.231717 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.231883 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.232061 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.232196 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.232383 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.232518 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.232696 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.232838 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.233016 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.233150 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.233327 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.233462 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.233636 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.233776 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.233945 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.234085 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.234295 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.234484 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.235145 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.235286 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.235479 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.235624 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.235828 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.235968 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.236129 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.236256 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.236453 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.236608 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.236763 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.236895 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.237079 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.237197 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.237385 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.237537 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.237701 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.237830 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.238017 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.238136 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.238336 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.238467 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.238657 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.238782 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.238977 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.239099 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.239287 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.239415 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.239603 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.239724 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.239936 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.240071 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.240288 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.240417 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.240537 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.240695 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.241023 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.241336 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.241652 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.241916 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.242062 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.242260 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.242402 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.242568 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.242716 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.242881 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.243017 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.243191 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.243334 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.243502 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.243652 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.243849 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.243975 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.244176 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.244297 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.244487 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.244616 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.244811 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.244934 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.245207 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.245324 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.245482 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.245574 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.245790 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.245896 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.246123 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.246214 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.246475 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.246567 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.246815 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.246905 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.247145 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.247249 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.247476 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.247577 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.247813 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.247906 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.248146 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.248251 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.248467 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.248560 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.248787 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.248887 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.249112 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.249217 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.249432 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.249524 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.249761 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.249852 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.250106 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.250213 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.250431 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.250520 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.250739 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.250845 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.251055 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.251192 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.251369 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.251558 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.251717 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.251952 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.252123 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.252271 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.252424 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.252577 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.252735 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.252879 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.253038 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.253183 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.253328 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.253479 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.253642 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.253795 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.253953 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.254099 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.254243 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.254387 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.254531 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.254681 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.254835 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.254988 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.255133 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.255284 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.255437 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.255601 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.255746 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.255899 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.255991 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.256087 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.256263 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.256367 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.256575 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.256672 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.256892 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.256985 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.257205 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.257306 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.257516 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.257637 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.257837 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.258054 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.258152 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.258246 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.258448 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.258549 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.258759 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.258851 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.259071 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.259171 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.259382 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.259474 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.259692 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.259814 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.260038 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.260139 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.260349 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.260448 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.260660 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.260762 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.260971 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.261089 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.261274 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.261416 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.261590 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.261772 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.262006 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.262159 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.262313 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.262467 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.262621 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.262782 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.262936 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.263081 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.263225 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.263406 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.263576 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.263738 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.263917 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.264072 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.264217 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.264360 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.264504 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.264721 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.264876 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.265028 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.265174 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.265318 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.265480 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.265672 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.265823 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.265968 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.266120 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.266265 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.266408 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.266567 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.266719 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.266873 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.267018 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.267241 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.267401 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.267554 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.267718 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.267911 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.268057 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.268200 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.268361 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.268514 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.268658 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.268809 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.268963 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.269108 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.269261 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.269419 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.269591 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.269754 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.269898 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.270049 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.270193 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.270337 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.270487 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.270746 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.270909 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.271057 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.271343 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.271598 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.271845 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.272025 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.272174 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.272324 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.272476 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.272629 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.272853 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.273010 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.273157 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.273316 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.273463 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.273616 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.273770 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.273916 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.274071 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.274217 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.274361 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.274513 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.274671 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.274816 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.274966 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.275110 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.275255 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.275412 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.275570 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.275716 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.275716 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.276114 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.276272 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.276435 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.276594 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.276740 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.276884 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.277029 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.277196 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.277352 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.277505 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.277649 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.277802 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.278029 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.278199 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.278199 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.278497 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.278642 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.278798 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.278953 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.279104 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.279263 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.279409 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.279561 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.279706 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.279871 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.280039 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.280200 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.280354 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.280507 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.280659 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.280802 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.280924 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.281061 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.281245 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.281930 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.282048 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.282160 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.282293 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.282413 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.282604 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.282723 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.282912 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.283003 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.283097 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.283183 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.283353 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.283457 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.283549 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.283659 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.283740 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.283867 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.283962 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.284051 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.284136 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.284221 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.284299 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.284382 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.284573 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.284766 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.284936 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.285086 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.285240 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.285386 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.285549 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.285710 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.285864 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.286016 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.286162 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.286315 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.286470 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.286634 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.286797 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.286944 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.287091 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.287241 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.287413 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.287570 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.287727 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.288015 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.288177 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.288322 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.288494 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.288647 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.288792 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.288979 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.289151 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.289302 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.289490 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.289636 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.289793 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.289956 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.290102 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.290255 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.290401 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.290546 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.290690 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.290846 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.291095 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.291325 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.291473 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.291617 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.291769 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.292018 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.292177 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.292336 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.292535 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.292684 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.292836 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.292982 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.293127 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.293281 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.293510 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.293657 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.293809 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.293965 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.294120 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.294265 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.294409 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.294559 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.294704 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.294848 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.295001 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.295152 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.295298 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.295449 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.295594 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.295738 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.295931 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.296078 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.296225 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.296377 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.296523 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.296685 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.296840 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.297669 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.297824 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.297970 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.298123 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.298289 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.298289 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.298587 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.298731 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.298883 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.299028 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.299182 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.299335 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.299494 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.299640 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.299815 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.299968 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.300125 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.300271 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.300424 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.300580 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.300725 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.300877 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.301031 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.301279 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.301438 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.301584 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.301728 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.301882 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.302028 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.302172 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.302316 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.302460 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.302626 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.302786 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.302939 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.303093 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.303244 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.303389 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.303534 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.303693 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.303855 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.304016 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.304169 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.304321 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.304484 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.304643 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.304797 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.304943 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.305086 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.305230 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.305382 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.305527 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.305672 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.305815 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.305966 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.306111 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.306265 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.306420 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.306563 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.306724 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.306880 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.307033 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.307187 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.307339 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.307491 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.307642 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.307803 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.307955 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.308111 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.308111 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.308410 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.308410 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.308692 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.308852 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.308997 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.309149 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.309294 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.309438 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.309582 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.309735 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.309888 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.310032 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.310176 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.310336 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.310481 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.310634 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.310786 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.310937 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.311082 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.311225 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.311468 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.311468 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.311759 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.311937 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.312102 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.312259 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.312411 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.312596 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.312744 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.312744 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.313024 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.313171 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.313328 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.313473 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.313636 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.313779 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.313931 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.314078 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.314241 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.314393 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.314546 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.314698 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.314843 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.314995 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.315153 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.315306 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.315458 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.315609 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.315755 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.315954 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.316114 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.316272 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.316424 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.316570 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.316729 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.316892 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.317044 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.317198 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.317345 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.317489 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.317633 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.317787 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.317932 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.318083 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.318247 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.318401 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.318555 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.318710 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.318862 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.319007 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.319158 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.319311 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.319470 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.319615 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.319805 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.319966 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.320129 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.320274 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.320499 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.320646 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.320816 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.321642 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.321802 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.321947 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.322102 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.322249 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.322394 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.322548 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.322702 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.322702 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.323005 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.323153 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.323297 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.323443 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.323587 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.323740 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.323923 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.324071 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.324215 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.324359 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.324503 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.324657 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.324814 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.324966 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.325119 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.325266 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.325424 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.325590 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.325741 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.325893 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.326045 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.326203 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.326354 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.326518 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.326698 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.326861 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.327020 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.327179 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.327343 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.327505 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.327667 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.327855 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.328025 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.328212 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.328212 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.328507 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.328669 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.328833 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.328993 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.329164 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.329316 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.329467 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.329625 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.329778 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.329937 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.330089 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.330247 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.330405 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.330564 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.330723 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.330899 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.331060 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.331212 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.331361 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.331512 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.331689 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.331949 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.332118 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.332271 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.332423 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.332574 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.332724 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.332886 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.333056 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.333218 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.333477 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.333642 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.333811 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.333966 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.334124 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.334277 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.334277 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.334578 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.334743 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.334902 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.335066 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.335218 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.335376 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.335528 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.335760 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.335999 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.336164 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.336323 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.336477 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.336636 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.336810 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.336971 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.337133 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.337305 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.337459 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.337628 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.337782 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.337934 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.338085 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.338237 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.338388 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.338553 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.338714 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.338877 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.339036 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.339196 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.339357 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.339519 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.339672 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.339856 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.340014 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.340166 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.340319 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.340480 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.340641 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.340801 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.340953 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.341111 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.341272 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.341435 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.341595 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.341754 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.341936 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.342175 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.342344 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.342505 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.342658 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.342816 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.342977 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.343129 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.343364 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.343538 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.343692 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.344436 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.344608 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.344764 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.344764 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.345082 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.345234 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.345393 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.345393 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.345690 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.345850 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.346002 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.346165 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.346317 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.346475 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.346637 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.346791 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.346942 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.347101 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.347385 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.347586 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.347796 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.347982 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.348146 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.348318 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.348482 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.348650 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.348811 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.348971 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.349132 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.349284 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.349435 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.349600 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.350019 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.350171 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.350322 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.350482 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.350664 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.350828 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.350981 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.351141 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.351294 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.351445 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.351609 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.351762 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.351948 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.352101 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.352357 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.352517 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.352690 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.352852 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.353012 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.353165 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.353317 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.353468 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.353629 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.353788 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.353942 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.354102 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.354254 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.354425 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.354600 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.354754 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.354906 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.355058 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.355217 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.355384 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.355537 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.355690 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.355858 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.356033 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.356192 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.356362 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.356530 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.356701 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.356862 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.357023 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.357183 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.357357 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.357518 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.357679 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.357831 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.357984 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.358203 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.358385 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.358550 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.358703 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.358866 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.359019 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.359181 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.359334 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.360086 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.360252 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.360405 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.360567 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.360738 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.360892 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.360892 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.361190 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.361377 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.361551 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.361704 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.361864 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.362036 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.362188 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.362360 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.362599 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.362758 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.362918 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.363071 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.363222 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.363384 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.363557 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.363711 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.363886 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.364052 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.364214 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.364214 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.364517 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.364679 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.364832 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.364985 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.365137 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.365302 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.365467 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.365627 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.365788 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.365941 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.366093 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.366258 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.366419 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.366580 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.366741 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.366901 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.367053 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.367053 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.367370 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.367539 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.367691 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.367888 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.368064 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.368219 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.368379 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.368540 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.368700 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.368852 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.369017 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.369170 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.369330 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.369494 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.369655 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.369864 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.370019 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.370179 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.370338 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.370491 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.370657 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.370819 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.370979 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.371132 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.371289 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.371460 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.371614 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.371776 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.371964 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.372117 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.372269 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.372421 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.372600 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.372849 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.373008 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.373160 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.373320 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.373474 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.373474 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.373793 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.373954 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.374107 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.374265 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.374416 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.374577 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.374728 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.374880 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.374880 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.375199 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.375360 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.375527 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.375691 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.375879 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.376048 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.376202 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.376363 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.376525 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.376686 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.376845 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.377006 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.377159 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.377399 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.377567 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.377731 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.377891 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.378050 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.378212 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.378379 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.378532 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.378684 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.378843 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.378843 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.379142 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.379304 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.379457 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.379618 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.379811 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.379982 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.380286 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.380492 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.380690 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.380879 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.381056 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.381220 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.381381 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.381381 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.381686 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.381846 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.382010 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.382175 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.382341 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.382502 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.382656 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.382827 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.383093 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.383261 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.383428 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.383590 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.383742 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.384021 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.384202 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.384389 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.384555 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.384716 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.384870 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.385033 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.385185 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.385420 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.385585 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.385738 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.385890 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.385890 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.386184 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.386346 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.386511 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.386511 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.386799 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.386799 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.387092 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.387092 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.387410 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.387576 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.387729 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.387910 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.388082 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.388237 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.388389 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.388562 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.388722 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.388722 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.389025 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.389181 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.389334 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.389486 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.389639 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.389797 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.389960 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.390114 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.390272 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.390434 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.390596 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.390793 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.390947 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.391107 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.391268 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.391422 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.391574 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.391740 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.391965 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.392128 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.392281 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.392439 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.392603 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.392770 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.392924 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.393101 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.393338 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.393496 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.393649 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.393815 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.393977 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.394129 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.394288 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.394440 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.394617 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.394781 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.394942 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.395095 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.395258 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.395258 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.395560 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.395714 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.395902 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.396057 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.396216 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.396376 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.396538 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.396701 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.396862 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.397021 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.397187 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.397352 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.397514 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.397674 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.397826 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.397979 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.398138 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.398304 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.398465 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.398618 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.398790 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.398944 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.399104 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.399271 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.399424 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.399584 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.399737 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.399940 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.400102 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.400269 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.400422 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.400574 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.400735 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.400896 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.401060 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.401223 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.401376 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.401529 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.401681 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.401841 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.402003 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.402157 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.402308 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.402481 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.402645 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.402797 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.402963 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.403124 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.403278 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.403521 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.403521 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.403861 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.403861 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.404173 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.404335 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.404496 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.404496 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.404809 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.404964 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.405123 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.405287 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.405448 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.405608 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.405773 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.405927 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.406139 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.406874 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.407041 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.407213 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.407388 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.407542 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.407693 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.407874 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.408032 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.408196 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.408350 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.408512 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.408665 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.408817 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.408968 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.409130 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.409292 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.409457 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.409609 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.409770 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.409924 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.410086 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.410248 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.410419 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 20 03:23:40.410607 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.410607 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.410607 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.410607 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.410607 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.410607 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.410607 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.410607 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.411766 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.411766 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.411766 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.411766 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.411766 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.411766 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.411766 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.411766 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.412953 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.412953 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.412953 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.412953 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.412953 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.412953 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.412953 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.412953 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.414206 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.414206 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.414206 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.414206 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.414206 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.414206 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.414206 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.415313 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.415313 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.415313 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.415313 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.415979 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.415979 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.416279 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.416583 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.416916 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.417250 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.417584 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.417918 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.418273 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.418595 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.418947 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.419282 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.419605 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.419962 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.420284 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 03:23:40.420534 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 20 03:23:40.427302 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_db.sqlalchemy.engines [None req-21ddd909-7bee-4c3a-a681-fefde3f4b812 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116114) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 03:23:40.444059 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_db.sqlalchemy.engines [None req-e882fcf6-d140-4495-b065-dcdbcb6c0c96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116113) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 03:23:40.586681 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.context [None req-21ddd909-7bee-4c3a-a681-fefde3f4b812 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),692e9fe6-a45f-4304-841f-fd5e8ac1537b(cell1) {{(pid=116114) load_cells /opt/stack/nova/nova/context.py:464}} Nov 20 03:23:40.591147 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-21ddd909-7bee-4c3a-a681-fefde3f4b812 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:23:40.592762 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-21ddd909-7bee-4c3a-a681-fefde3f4b812 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:23:40.593624 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-21ddd909-7bee-4c3a-a681-fefde3f4b812 None None] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:23:40.596153 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-21ddd909-7bee-4c3a-a681-fefde3f4b812 None None] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:23:40.606126 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.context [None req-e882fcf6-d140-4495-b065-dcdbcb6c0c96 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),692e9fe6-a45f-4304-841f-fd5e8ac1537b(cell1) {{(pid=116113) load_cells /opt/stack/nova/nova/context.py:464}} Nov 20 03:23:40.607559 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_db.sqlalchemy.engines [None req-21ddd909-7bee-4c3a-a681-fefde3f4b812 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116114) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 03:23:40.608528 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_db.sqlalchemy.engines [None req-21ddd909-7bee-4c3a-a681-fefde3f4b812 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116114) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 03:23:40.610799 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e882fcf6-d140-4495-b065-dcdbcb6c0c96 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:23:40.612470 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e882fcf6-d140-4495-b065-dcdbcb6c0c96 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:23:40.613773 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e882fcf6-d140-4495-b065-dcdbcb6c0c96 None None] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:23:40.615329 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e882fcf6-d140-4495-b065-dcdbcb6c0c96 None None] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:23:40.626442 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_db.sqlalchemy.engines [None req-e882fcf6-d140-4495-b065-dcdbcb6c0c96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116113) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 03:23:40.627285 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_db.sqlalchemy.engines [None req-e882fcf6-d140-4495-b065-dcdbcb6c0c96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116113) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 03:23:40.776822 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_db.sqlalchemy.engines [None req-21ddd909-7bee-4c3a-a681-fefde3f4b812 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116114) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 03:23:40.792588 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_db.sqlalchemy.engines [None req-e882fcf6-d140-4495-b065-dcdbcb6c0c96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116113) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 03:23:41.106381 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: WARNING keystonemiddleware.auth_token [None req-21ddd909-7bee-4c3a-a681-fefde3f4b812 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 20 03:23:41.115005 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: WARNING keystonemiddleware.auth_token [None req-21ddd909-7bee-4c3a-a681-fefde3f4b812 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 20 03:23:41.128341 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: WARNING keystonemiddleware.auth_token [None req-e882fcf6-d140-4495-b065-dcdbcb6c0c96 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 20 03:23:41.134906 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: WARNING keystonemiddleware.auth_token [None req-e882fcf6-d140-4495-b065-dcdbcb6c0c96 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 20 03:23:41.464861 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: WARNING keystonemiddleware.auth_token [None req-21ddd909-7bee-4c3a-a681-fefde3f4b812 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 20 03:23:41.470286 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: WARNING keystonemiddleware.auth_token [None req-21ddd909-7bee-4c3a-a681-fefde3f4b812 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 20 03:23:41.476366 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5643670e19c0 pid: 116114 (default app) Nov 20 03:23:41.479034 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: WARNING keystonemiddleware.auth_token [None req-e882fcf6-d140-4495-b065-dcdbcb6c0c96 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 20 03:23:41.484251 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: WARNING keystonemiddleware.auth_token [None req-e882fcf6-d140-4495-b065-dcdbcb6c0c96 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 20 03:23:41.490128 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5643670e19c0 pid: 116113 (default app) Nov 20 03:24:14.461267 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-90a822ce-3536-4193-bfd2-66882c02de7d tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] Action: 'create', calling method: .version_select at 0x7f2dae7e34c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1996398033"}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:24:15.707136 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-8650f971-83b8-4ad3-9f94-9f0a7c05e717 tempest-VolumesGetTestJSON-1804565964 tempest-VolumesGetTestJSON-1804565964-project] Action: 'create', calling method: .version_select at 0x7f2dae7e54c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-688433307", "metadata": {"Type": "work"}}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:24:16.369715 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-90a822ce-3536-4193-bfd2-66882c02de7d tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.939106 Nov 20 03:24:16.370773 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 1/1] 10.222.0.37 () {60 vars in 1154 bytes} [Sat Nov 20 03:24:13 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 2943 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Nov 20 03:24:16.960087 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-494151e1-8a91-44c1-aea7-b3f99508a2a8 tempest-VolumesNegativeTest-1805047423 tempest-VolumesNegativeTest-1805047423-project] Action: 'create', calling method: .version_select at 0x7f2dae7b50d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2125871656", "metadata": {"Type": "work"}}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:24:16.961578 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-494151e1-8a91-44c1-aea7-b3f99508a2a8 tempest-VolumesNegativeTest-1805047423 tempest-VolumesNegativeTest-1805047423-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:24:16.962401 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-494151e1-8a91-44c1-aea7-b3f99508a2a8 tempest-VolumesNegativeTest-1805047423 tempest-VolumesNegativeTest-1805047423-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.590344 Nov 20 03:24:16.967361 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 2/2] 10.222.0.37 () {60 vars in 1155 bytes} [Sat Nov 20 03:24:16 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 592 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 03:24:16.971713 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-c207d15d-b0f8-48dc-ad66-f2f291662e9d tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] Calling method '.version_select at 0x7f2daf088b80>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:17.001920 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-8650f971-83b8-4ad3-9f94-9f0a7c05e717 tempest-VolumesGetTestJSON-1804565964 tempest-VolumesGetTestJSON-1804565964-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.518035 Nov 20 03:24:17.009801 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 1/3] 10.222.0.37 () {60 vars in 1155 bytes} [Sat Nov 20 03:24:14 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 2527 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 20 03:24:17.088411 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-c207d15d-b0f8-48dc-ad66-f2f291662e9d tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/371f7448-9777-44b8-afcf-ed7326145339" status: 200 len: 345 microversion: 2.1 time: 0.123374 Nov 20 03:24:17.088986 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 3/4] 10.222.0.37 () {58 vars in 1244 bytes} [Sat Nov 20 03:24:16 2021] GET /compute/v2.1/os-volumes/371f7448-9777-44b8-afcf-ed7326145339 => generated 345 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:24:17.123157 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-317dd0e1-276b-4261-86c7-e57a2bb7b5b5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-31765108", "imageRef": "e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0", "flavorRef": "452", "networks": [{"uuid": "a1acacc5-2d91-42ad-971f-cecd3a0dc9a5"}]}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:24:17.157525 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-717e9d00-de54-4160-9570-87ad834519cd tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1313968563", "imageRef": "e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0", "flavorRef": "452", "networks": [{"uuid": "6d41a12a-126d-47ed-a3db-e47c15076113"}]}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:24:17.258086 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.network.neutron [None req-317dd0e1-276b-4261-86c7-e57a2bb7b5b5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] validate_networks() for [('a1acacc5-2d91-42ad-971f-cecd3a0dc9a5', None, None, None, None, None)] {{(pid=116113) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 03:24:17.276159 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.network.neutron [None req-717e9d00-de54-4160-9570-87ad834519cd tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] validate_networks() for [('6d41a12a-126d-47ed-a3db-e47c15076113', None, None, None, None, None)] {{(pid=116114) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 03:24:18.727395 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-317dd0e1-276b-4261-86c7-e57a2bb7b5b5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Flavor limits 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 03:24:18.728646 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-317dd0e1-276b-4261-86c7-e57a2bb7b5b5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Image limits 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 03:24:18.729447 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-317dd0e1-276b-4261-86c7-e57a2bb7b5b5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Flavor pref 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 03:24:18.730074 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-317dd0e1-276b-4261-86c7-e57a2bb7b5b5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Image pref 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 03:24:18.730865 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-317dd0e1-276b-4261-86c7-e57a2bb7b5b5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 03:24:18.816185 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-717e9d00-de54-4160-9570-87ad834519cd tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Flavor limits 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 03:24:18.816185 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-717e9d00-de54-4160-9570-87ad834519cd tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Image limits 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 03:24:18.816185 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-717e9d00-de54-4160-9570-87ad834519cd tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Flavor pref 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 03:24:18.816185 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-717e9d00-de54-4160-9570-87ad834519cd tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Image pref 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 03:24:18.816185 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-717e9d00-de54-4160-9570-87ad834519cd tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 03:24:18.817117 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-717e9d00-de54-4160-9570-87ad834519cd tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:18.817117 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-717e9d00-de54-4160-9570-87ad834519cd tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:18.817117 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-717e9d00-de54-4160-9570-87ad834519cd tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:18.817117 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-717e9d00-de54-4160-9570-87ad834519cd tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:18.817529 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-317dd0e1-276b-4261-86c7-e57a2bb7b5b5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:18.817529 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-317dd0e1-276b-4261-86c7-e57a2bb7b5b5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:18.817529 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-317dd0e1-276b-4261-86c7-e57a2bb7b5b5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:18.817529 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-317dd0e1-276b-4261-86c7-e57a2bb7b5b5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:18.827130 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-717e9d00-de54-4160-9570-87ad834519cd tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Getting quotas for project 73ef1bfbb0ec4c3aa4eece7894279f75. Resources: {'ram', 'cores', 'instances'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:24:18.837805 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-717e9d00-de54-4160-9570-87ad834519cd tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Getting quotas for user 3f56de24d6214bb8bd0d4e86beca830c and project 73ef1bfbb0ec4c3aa4eece7894279f75. Resources: {'ram', 'cores', 'instances'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:24:18.853162 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-717e9d00-de54-4160-9570-87ad834519cd tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Going to run 1 instances... {{(pid=116114) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 03:24:18.857102 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-317dd0e1-276b-4261-86c7-e57a2bb7b5b5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Getting quotas for project 0fdf6e7abf574b269f3c1459a9d58c26. Resources: {'ram', 'cores', 'instances'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:24:18.857882 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-717e9d00-de54-4160-9570-87ad834519cd tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 03:24:18.869968 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-317dd0e1-276b-4261-86c7-e57a2bb7b5b5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Getting quotas for user e05b767f39ea49e4aa916c818a4290e7 and project 0fdf6e7abf574b269f3c1459a9d58c26. Resources: {'ram', 'cores', 'instances'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:24:18.899094 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-317dd0e1-276b-4261-86c7-e57a2bb7b5b5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Going to run 1 instances... {{(pid=116113) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 03:24:18.916876 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-317dd0e1-276b-4261-86c7-e57a2bb7b5b5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 03:24:18.995337 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-717e9d00-de54-4160-9570-87ad834519cd tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.904981 Nov 20 03:24:18.996937 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 4/5] 10.222.0.37 () {60 vars in 1146 bytes} [Sat Nov 20 03:24:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 1907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 03:24:19.004678 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-ef7f9671-7b8d-4c55-90a5-4949f73c8fa3 tempest-VolumesNegativeTest-1805047423 tempest-VolumesNegativeTest-1805047423-project] Action: 'create', calling method: .version_select at 0x7f2dae5b49d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-699358102", "metadata": {"Type": "work"}}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:24:19.007425 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-ef7f9671-7b8d-4c55-90a5-4949f73c8fa3 tempest-VolumesNegativeTest-1805047423 tempest-VolumesNegativeTest-1805047423-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:24:19.008492 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-ef7f9671-7b8d-4c55-90a5-4949f73c8fa3 tempest-VolumesNegativeTest-1805047423 tempest-VolumesNegativeTest-1805047423-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010157 Nov 20 03:24:19.010825 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 5/6] 10.222.0.37 () {60 vars in 1155 bytes} [Sat Nov 20 03:24:18 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 03:24:19.035171 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-441a53b9-4f9a-4f51-a9a4-8a86e42ba6cb tempest-VolumesGetTestJSON-1804565964 tempest-VolumesGetTestJSON-1804565964-project] Calling method '.version_select at 0x7f2dad558280>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:19.131081 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-317dd0e1-276b-4261-86c7-e57a2bb7b5b5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.119910 Nov 20 03:24:19.132318 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 2/7] 10.222.0.37 () {60 vars in 1146 bytes} [Sat Nov 20 03:24:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 2122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 03:24:19.152517 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-a1b43dc3-134a-49ae-8da3-1e80a1caf5c2 tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] Calling method '.version_select at 0x7f2dae5b2820>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:19.183600 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-441a53b9-4f9a-4f51-a9a4-8a86e42ba6cb tempest-VolumesGetTestJSON-1804565964 tempest-VolumesGetTestJSON-1804565964-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/bf0bd094-dfc7-4f65-98c9-a549c3d59c3d" status: 200 len: 353 microversion: 2.1 time: 0.154051 Nov 20 03:24:19.184639 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 6/8] 10.222.0.37 () {58 vars in 1244 bytes} [Sat Nov 20 03:24:19 2021] GET /compute/v2.1/os-volumes/bf0bd094-dfc7-4f65-98c9-a549c3d59c3d => generated 353 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:24:19.190292 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-95fc3d33-938a-4370-b8a4-f89bffd2af24 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:19.191251 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-95fc3d33-938a-4370-b8a4-f89bffd2af24 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:19.341976 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-a1b43dc3-134a-49ae-8da3-1e80a1caf5c2 tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/371f7448-9777-44b8-afcf-ed7326145339" status: 200 len: 346 microversion: 2.1 time: 0.195808 Nov 20 03:24:19.342627 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 3/9] 10.222.0.37 () {58 vars in 1244 bytes} [Sat Nov 20 03:24:19 2021] GET /compute/v2.1/os-volumes/371f7448-9777-44b8-afcf-ed7326145339 => generated 346 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:24:19.353044 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-450f7fa1-8e3c-44d8-a295-a146aea62c6d tempest-VolumesNegativeTest-1805047423 tempest-VolumesNegativeTest-1805047423-project] Action: 'create', calling method: .version_select at 0x7f2dad5584c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-145160789", "metadata": {"Type": "work"}}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:24:19.354962 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-450f7fa1-8e3c-44d8-a295-a146aea62c6d tempest-VolumesNegativeTest-1805047423 tempest-VolumesNegativeTest-1805047423-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:24:19.356785 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-450f7fa1-8e3c-44d8-a295-a146aea62c6d tempest-VolumesNegativeTest-1805047423 tempest-VolumesNegativeTest-1805047423-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012946 Nov 20 03:24:19.360268 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 4/10] 10.222.0.37 () {60 vars in 1155 bytes} [Sat Nov 20 03:24:19 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 03:24:19.378410 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-54d63cf5-3724-42ef-ac3c-bfb243066adb tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:19.381492 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-54d63cf5-3724-42ef-ac3c-bfb243066adb tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:19.423273 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-95fc3d33-938a-4370-b8a4-f89bffd2af24 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:19.450864 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-95fc3d33-938a-4370-b8a4-f89bffd2af24 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1215 microversion: 2.1 time: 0.264642 Nov 20 03:24:19.451453 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 7/11] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:19 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1215 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:19.459522 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-844d60f6-a28f-4022-b56e-f10ba9071420 tempest-VolumesGetTestJSON-1804565964 tempest-VolumesGetTestJSON-1804565964-project] Calling method '.version_select at 0x7f2dad5589d0>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:19.554858 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-844d60f6-a28f-4022-b56e-f10ba9071420 tempest-VolumesGetTestJSON-1804565964 tempest-VolumesGetTestJSON-1804565964-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/bf0bd094-dfc7-4f65-98c9-a549c3d59c3d" status: 200 len: 353 microversion: 2.1 time: 0.098839 Nov 20 03:24:19.555425 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 8/12] 10.222.0.37 () {58 vars in 1244 bytes} [Sat Nov 20 03:24:19 2021] GET /compute/v2.1/os-volumes/bf0bd094-dfc7-4f65-98c9-a549c3d59c3d => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:24:19.559933 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-b5f431ac-3cc0-462f-a03f-87fb128f8308 tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] Action: 'create', calling method: .version_select at 0x7f2dad57dee0>, body: {"snapshot": {"volume_id": "371f7448-9777-44b8-afcf-ed7326145339", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-540366678"}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:24:19.757847 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-54d63cf5-3724-42ef-ac3c-bfb243066adb tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:19.801406 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-54d63cf5-3724-42ef-ac3c-bfb243066adb tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 200 len: 1216 microversion: 2.1 time: 0.438024 Nov 20 03:24:19.802877 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 5/13] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:19 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 1216 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:19.831652 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-81264921-95b0-4ee4-a64d-fdd6723d772e tempest-VolumesNegativeTest-1805047423 tempest-VolumesNegativeTest-1805047423-project] Calling method '.version_select at 0x7f2dad570160>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:19.918690 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.wsgi [None req-81264921-95b0-4ee4-a64d-fdd6723d772e tempest-VolumesNegativeTest-1805047423 tempest-VolumesNegativeTest-1805047423-project] HTTP exception thrown: Volume tempest-invalid-1479387562 could not be found. Nov 20 03:24:19.919551 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-81264921-95b0-4ee4-a64d-fdd6723d772e tempest-VolumesNegativeTest-1805047423 tempest-VolumesNegativeTest-1805047423-project] Returning 404 to user: Volume tempest-invalid-1479387562 could not be found. {{(pid=116113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:24:19.920673 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-81264921-95b0-4ee4-a64d-fdd6723d772e tempest-VolumesNegativeTest-1805047423 tempest-VolumesNegativeTest-1805047423-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1479387562" status: 404 len: 99 microversion: 2.1 time: 0.116635 Nov 20 03:24:19.921931 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 6/14] 10.222.0.37 () {58 vars in 1217 bytes} [Sat Nov 20 03:24:19 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1479387562 => generated 99 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 03:24:19.938703 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-80e06e11-30bc-4ac1-b655-0ab344c21bb2 tempest-VolumesGetTestJSON-1804565964 tempest-VolumesGetTestJSON-1804565964-project] Calling method '.version_select at 0x7f2dae5b2dc0>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:20.004510 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-b5f431ac-3cc0-462f-a03f-87fb128f8308 tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] 10.222.0.37 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.447819 Nov 20 03:24:20.005978 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 9/15] 10.222.0.37 () {60 vars in 1161 bytes} [Sat Nov 20 03:24:19 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:24:20.010964 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-c1377411-fb05-493b-a2a9-b13fb814fd14 tempest-VolumesNegativeTest-1805047423 tempest-VolumesNegativeTest-1805047423-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003743 Nov 20 03:24:20.020193 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 10/16] 10.222.0.37 () {58 vars in 1139 bytes} [Sat Nov 20 03:24:20 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 20 03:24:20.039829 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-6b817421-6d5c-480d-b70d-d41fe820c97f tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] Calling method '.version_select at 0x7f2dad592af0>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:20.162985 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-6b817421-6d5c-480d-b70d-d41fe820c97f tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/1dabe139-7272-4eb5-9d23-8a02ea6f4938" status: 200 len: 286 microversion: 2.1 time: 0.141038 Nov 20 03:24:20.163908 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 11/17] 10.222.0.37 () {58 vars in 1250 bytes} [Sat Nov 20 03:24:20 2021] GET /compute/v2.1/os-snapshots/1dabe139-7272-4eb5-9d23-8a02ea6f4938 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:24:20.170272 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-004e3474-59b0-4e3a-a76c-fd7d58c175d0 tempest-VolumesNegativeTest-1805047423 tempest-VolumesNegativeTest-1805047423-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004440 Nov 20 03:24:20.183474 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 12/18] 10.222.0.37 () {58 vars in 1136 bytes} [Sat Nov 20 03:24:20 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 20 03:24:20.204292 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-9e739789-1f6d-449e-8c57-206771318394 tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] Calling method '.version_select at 0x7f2dad565ca0>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:20.235570 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-80e06e11-30bc-4ac1-b655-0ab344c21bb2 tempest-VolumesGetTestJSON-1804565964 tempest-VolumesGetTestJSON-1804565964-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/bf0bd094-dfc7-4f65-98c9-a549c3d59c3d" status: 202 len: 0 microversion: 2.1 time: 0.309424 Nov 20 03:24:20.236276 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 7/19] 10.222.0.37 () {58 vars in 1247 bytes} [Sat Nov 20 03:24:19 2021] DELETE /compute/v2.1/os-volumes/bf0bd094-dfc7-4f65-98c9-a549c3d59c3d => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:24:20.242035 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-503cfebb-b45b-4886-986e-8c1981de9e6f tempest-VolumesNegativeTest-1805047423 tempest-VolumesNegativeTest-1805047423-project] Calling method '.version_select at 0x7f2dad57e700>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:20.326563 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.wsgi [None req-503cfebb-b45b-4886-986e-8c1981de9e6f tempest-VolumesNegativeTest-1805047423 tempest-VolumesNegativeTest-1805047423-project] HTTP exception thrown: Volume e11ca65d-722d-4766-a033-05bc548f5415 could not be found. Nov 20 03:24:20.327880 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-503cfebb-b45b-4886-986e-8c1981de9e6f tempest-VolumesNegativeTest-1805047423 tempest-VolumesNegativeTest-1805047423-project] Returning 404 to user: Volume e11ca65d-722d-4766-a033-05bc548f5415 could not be found. {{(pid=116113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:24:20.328877 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-503cfebb-b45b-4886-986e-8c1981de9e6f tempest-VolumesNegativeTest-1805047423 tempest-VolumesNegativeTest-1805047423-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/e11ca65d-722d-4766-a033-05bc548f5415" status: 404 len: 109 microversion: 2.1 time: 0.091377 Nov 20 03:24:20.329968 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 8/20] 10.222.0.37 () {58 vars in 1247 bytes} [Sat Nov 20 03:24:20 2021] DELETE /compute/v2.1/os-volumes/e11ca65d-722d-4766-a033-05bc548f5415 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:24:20.335879 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-05fc4466-1090-44b7-b4b6-4f532b7590f4 tempest-VolumesGetTestJSON-1804565964 tempest-VolumesGetTestJSON-1804565964-project] Calling method '.version_select at 0x7f2dad57e940>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:20.366054 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-9e739789-1f6d-449e-8c57-206771318394 tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.179364 Nov 20 03:24:20.367141 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 13/21] 10.222.0.37 () {58 vars in 1139 bytes} [Sat Nov 20 03:24:20 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:24:20.372451 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-c83d5680-35ec-43ca-9ee9-ba8edd3105aa tempest-VolumesNegativeTest-1805047423 tempest-VolumesNegativeTest-1805047423-project] Calling method '.version_select at 0x7f2dad592c10>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:20.440187 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.wsgi [None req-c83d5680-35ec-43ca-9ee9-ba8edd3105aa tempest-VolumesNegativeTest-1805047423 tempest-VolumesNegativeTest-1805047423-project] HTTP exception thrown: Volume d5d312da-36f1-4a78-91d5-b2b7a6b1b922 could not be found. Nov 20 03:24:20.440794 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-c83d5680-35ec-43ca-9ee9-ba8edd3105aa tempest-VolumesNegativeTest-1805047423 tempest-VolumesNegativeTest-1805047423-project] Returning 404 to user: Volume d5d312da-36f1-4a78-91d5-b2b7a6b1b922 could not be found. {{(pid=116114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:24:20.441903 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-c83d5680-35ec-43ca-9ee9-ba8edd3105aa tempest-VolumesNegativeTest-1805047423 tempest-VolumesNegativeTest-1805047423-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/d5d312da-36f1-4a78-91d5-b2b7a6b1b922" status: 404 len: 109 microversion: 2.1 time: 0.073320 Nov 20 03:24:20.445092 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 14/22] 10.222.0.37 () {58 vars in 1244 bytes} [Sat Nov 20 03:24:20 2021] GET /compute/v2.1/os-volumes/d5d312da-36f1-4a78-91d5-b2b7a6b1b922 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:24:20.458721 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-22f47930-6120-4a96-9e16-26b1bf278a5d tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] Calling method '.version_select at 0x7f2dad57d3a0>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:20.555650 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-05fc4466-1090-44b7-b4b6-4f532b7590f4 tempest-VolumesGetTestJSON-1804565964 tempest-VolumesGetTestJSON-1804565964-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/bf0bd094-dfc7-4f65-98c9-a549c3d59c3d" status: 200 len: 352 microversion: 2.1 time: 0.224196 Nov 20 03:24:20.556540 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 9/23] 10.222.0.37 () {58 vars in 1244 bytes} [Sat Nov 20 03:24:20 2021] GET /compute/v2.1/os-volumes/bf0bd094-dfc7-4f65-98c9-a549c3d59c3d => generated 352 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:24:20.561338 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-71ed04bf-7995-41f4-8282-948429872a22 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:20.562059 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-22f47930-6120-4a96-9e16-26b1bf278a5d tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/1dabe139-7272-4eb5-9d23-8a02ea6f4938" status: 200 len: 286 microversion: 2.1 time: 0.110429 Nov 20 03:24:20.563218 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 15/24] 10.222.0.37 () {58 vars in 1250 bytes} [Sat Nov 20 03:24:20 2021] GET /compute/v2.1/os-snapshots/1dabe139-7272-4eb5-9d23-8a02ea6f4938 => generated 286 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:24:20.563366 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-71ed04bf-7995-41f4-8282-948429872a22 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:20.725680 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-71ed04bf-7995-41f4-8282-948429872a22 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:20.732765 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-71ed04bf-7995-41f4-8282-948429872a22 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1215 microversion: 2.1 time: 0.175142 Nov 20 03:24:20.733329 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 10/25] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:20 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1215 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:20.834574 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-59f176d8-120a-4f3a-b2b9-720109ab72d2 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:20.838662 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-59f176d8-120a-4f3a-b2b9-720109ab72d2 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:21.045738 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-59f176d8-120a-4f3a-b2b9-720109ab72d2 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:21.056911 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-59f176d8-120a-4f3a-b2b9-720109ab72d2 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 200 len: 1216 microversion: 2.1 time: 0.240879 Nov 20 03:24:21.060830 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 16/26] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:20 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 1216 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:21.571012 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-0f38f3eb-c725-4640-b7ab-9486f5a46905 tempest-VolumesGetTestJSON-1804565964 tempest-VolumesGetTestJSON-1804565964-project] Calling method '.version_select at 0x7f2dad57ea60>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:21.573530 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-644d5c74-53a1-4053-aa53-2d9ff68959cf tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] Calling method '.version_select at 0x7f2dae6af790>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:21.642413 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-644d5c74-53a1-4053-aa53-2d9ff68959cf tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/1dabe139-7272-4eb5-9d23-8a02ea6f4938" status: 200 len: 286 microversion: 2.1 time: 0.072409 Nov 20 03:24:21.643127 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 17/27] 10.222.0.37 () {58 vars in 1250 bytes} [Sat Nov 20 03:24:21 2021] GET /compute/v2.1/os-snapshots/1dabe139-7272-4eb5-9d23-8a02ea6f4938 => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:24:21.723952 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-0f38f3eb-c725-4640-b7ab-9486f5a46905 tempest-VolumesGetTestJSON-1804565964 tempest-VolumesGetTestJSON-1804565964-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/bf0bd094-dfc7-4f65-98c9-a549c3d59c3d" status: 200 len: 352 microversion: 2.1 time: 0.158479 Nov 20 03:24:21.729275 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 11/28] 10.222.0.37 () {58 vars in 1244 bytes} [Sat Nov 20 03:24:21 2021] GET /compute/v2.1/os-volumes/bf0bd094-dfc7-4f65-98c9-a549c3d59c3d => generated 352 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:24:21.751515 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-e7b1e90d-e81f-4cd9-b126-63bc5f9c069d tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:21.752481 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-e7b1e90d-e81f-4cd9-b126-63bc5f9c069d tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:21.952791 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-e7b1e90d-e81f-4cd9-b126-63bc5f9c069d tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:21.960229 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-e7b1e90d-e81f-4cd9-b126-63bc5f9c069d tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1215 microversion: 2.1 time: 0.214014 Nov 20 03:24:21.964552 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 18/29] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:21 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1215 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:22.079726 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ca084684-2083-4694-b884-f3f1fdfe963c tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:22.080555 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ca084684-2083-4694-b884-f3f1fdfe963c tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:22.087067 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ca084684-2083-4694-b884-f3f1fdfe963c tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:22.095617 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ca084684-2083-4694-b884-f3f1fdfe963c tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:22.101591 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ca084684-2083-4694-b884-f3f1fdfe963c tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:22.103570 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ca084684-2083-4694-b884-f3f1fdfe963c tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:22.375781 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-ca084684-2083-4694-b884-f3f1fdfe963c tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:22.396375 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ca084684-2083-4694-b884-f3f1fdfe963c tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 200 len: 1220 microversion: 2.1 time: 0.322680 Nov 20 03:24:22.397282 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 12/30] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:22 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 1220 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:22.653361 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-f080b51c-8676-4493-97c7-380ebf3c3677 tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] Calling method '.version_select at 0x7f2dae5b4940>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:22.731398 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-f080b51c-8676-4493-97c7-380ebf3c3677 tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/1dabe139-7272-4eb5-9d23-8a02ea6f4938" status: 200 len: 286 microversion: 2.1 time: 0.081497 Nov 20 03:24:22.732210 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 19/31] 10.222.0.37 () {58 vars in 1250 bytes} [Sat Nov 20 03:24:22 2021] GET /compute/v2.1/os-snapshots/1dabe139-7272-4eb5-9d23-8a02ea6f4938 => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:24:22.736914 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-914f8eb3-3f0e-4ea6-9a61-9dbceba6d37a tempest-VolumesGetTestJSON-1804565964 tempest-VolumesGetTestJSON-1804565964-project] Calling method '.version_select at 0x7f2dad4f1b80>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:22.848286 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-914f8eb3-3f0e-4ea6-9a61-9dbceba6d37a tempest-VolumesGetTestJSON-1804565964 tempest-VolumesGetTestJSON-1804565964-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/bf0bd094-dfc7-4f65-98c9-a549c3d59c3d" status: 200 len: 352 microversion: 2.1 time: 0.115523 Nov 20 03:24:22.849863 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 13/32] 10.222.0.37 () {58 vars in 1244 bytes} [Sat Nov 20 03:24:22 2021] GET /compute/v2.1/os-volumes/bf0bd094-dfc7-4f65-98c9-a549c3d59c3d => generated 352 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:24:22.978050 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-c30cf58e-fb3f-4feb-a294-5a067a944146 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:22.978665 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-c30cf58e-fb3f-4feb-a294-5a067a944146 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:22.993060 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c30cf58e-fb3f-4feb-a294-5a067a944146 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:22.993559 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c30cf58e-fb3f-4feb-a294-5a067a944146 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:22.994522 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c30cf58e-fb3f-4feb-a294-5a067a944146 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:22.994957 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c30cf58e-fb3f-4feb-a294-5a067a944146 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:23.251000 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-c30cf58e-fb3f-4feb-a294-5a067a944146 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:23.275931 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-c30cf58e-fb3f-4feb-a294-5a067a944146 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1219 microversion: 2.1 time: 0.298494 Nov 20 03:24:23.277309 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 20/33] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:22 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1219 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:24:23.414654 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-b488e6ae-e077-4fae-afba-4cc0acb7b6a5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:23.416427 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-b488e6ae-e077-4fae-afba-4cc0acb7b6a5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:23.455276 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b488e6ae-e077-4fae-afba-4cc0acb7b6a5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:23.456508 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b488e6ae-e077-4fae-afba-4cc0acb7b6a5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:23.464090 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b488e6ae-e077-4fae-afba-4cc0acb7b6a5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:23.466723 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b488e6ae-e077-4fae-afba-4cc0acb7b6a5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:23.743613 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-f05cfc8b-7610-456e-b6ad-5233c31b6cde tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] Calling method '.version_select at 0x7f2dad5080d0>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:23.829720 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-f05cfc8b-7610-456e-b6ad-5233c31b6cde tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/1dabe139-7272-4eb5-9d23-8a02ea6f4938" status: 200 len: 287 microversion: 2.1 time: 0.090077 Nov 20 03:24:23.830682 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 21/34] 10.222.0.37 () {58 vars in 1250 bytes} [Sat Nov 20 03:24:23 2021] GET /compute/v2.1/os-snapshots/1dabe139-7272-4eb5-9d23-8a02ea6f4938 => generated 287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:24:23.840197 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-13dbc8ca-d54b-4ea5-a9e2-5929ebbd5ae0 tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] Calling method '.version_select at 0x7f2dad508d30>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:23.925376 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-b488e6ae-e077-4fae-afba-4cc0acb7b6a5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:23.940677 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-b488e6ae-e077-4fae-afba-4cc0acb7b6a5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 200 len: 1220 microversion: 2.1 time: 0.531461 Nov 20 03:24:23.941234 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 14/35] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:23 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 1220 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:24:23.988266 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-72a5fa98-7970-4eef-af74-7deb8d8126fd tempest-VolumesGetTestJSON-1804565964 tempest-VolumesGetTestJSON-1804565964-project] Calling method '.version_select at 0x7f2dad4ff5e0>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:24.055667 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-13dbc8ca-d54b-4ea5-a9e2-5929ebbd5ae0 tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] 10.222.0.37 "DELETE /compute/v2.1/os-snapshots/1dabe139-7272-4eb5-9d23-8a02ea6f4938" status: 202 len: 0 microversion: 2.1 time: 0.218945 Nov 20 03:24:24.057520 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 22/36] 10.222.0.37 () {58 vars in 1253 bytes} [Sat Nov 20 03:24:23 2021] DELETE /compute/v2.1/os-snapshots/1dabe139-7272-4eb5-9d23-8a02ea6f4938 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:24:24.065781 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-51b2b6e6-30e5-458b-b652-9d8c99d16d4a tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] Calling method '.version_select at 0x7f2dad508790>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:24.113333 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.wsgi [None req-72a5fa98-7970-4eef-af74-7deb8d8126fd tempest-VolumesGetTestJSON-1804565964 tempest-VolumesGetTestJSON-1804565964-project] HTTP exception thrown: Volume bf0bd094-dfc7-4f65-98c9-a549c3d59c3d could not be found. Nov 20 03:24:24.113929 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-72a5fa98-7970-4eef-af74-7deb8d8126fd tempest-VolumesGetTestJSON-1804565964 tempest-VolumesGetTestJSON-1804565964-project] Returning 404 to user: Volume bf0bd094-dfc7-4f65-98c9-a549c3d59c3d could not be found. {{(pid=116113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:24:24.114757 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-72a5fa98-7970-4eef-af74-7deb8d8126fd tempest-VolumesGetTestJSON-1804565964 tempest-VolumesGetTestJSON-1804565964-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/bf0bd094-dfc7-4f65-98c9-a549c3d59c3d" status: 404 len: 109 microversion: 2.1 time: 0.145787 Nov 20 03:24:24.115297 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 15/37] 10.222.0.37 () {58 vars in 1244 bytes} [Sat Nov 20 03:24:23 2021] GET /compute/v2.1/os-volumes/bf0bd094-dfc7-4f65-98c9-a549c3d59c3d => generated 109 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:24:24.192683 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-51b2b6e6-30e5-458b-b652-9d8c99d16d4a tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/1dabe139-7272-4eb5-9d23-8a02ea6f4938" status: 200 len: 286 microversion: 2.1 time: 0.130915 Nov 20 03:24:24.195194 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 23/38] 10.222.0.37 () {58 vars in 1250 bytes} [Sat Nov 20 03:24:24 2021] GET /compute/v2.1/os-snapshots/1dabe139-7272-4eb5-9d23-8a02ea6f4938 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:24:24.294311 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-eb087f39-a7b8-40f7-9531-dc3a3ae5d077 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:24.294928 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-eb087f39-a7b8-40f7-9531-dc3a3ae5d077 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:24.308454 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-eb087f39-a7b8-40f7-9531-dc3a3ae5d077 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:24.309208 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-eb087f39-a7b8-40f7-9531-dc3a3ae5d077 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:24.312457 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-eb087f39-a7b8-40f7-9531-dc3a3ae5d077 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:24.314793 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-eb087f39-a7b8-40f7-9531-dc3a3ae5d077 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:24.435041 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-eb087f39-a7b8-40f7-9531-dc3a3ae5d077 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:24.443232 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-eb087f39-a7b8-40f7-9531-dc3a3ae5d077 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1211 microversion: 2.1 time: 0.153546 Nov 20 03:24:24.447041 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 16/39] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:24 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1211 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:24.958848 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-1e018789-e60a-4e98-9341-14df28c70286 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:24.961763 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-1e018789-e60a-4e98-9341-14df28c70286 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:24.974891 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1e018789-e60a-4e98-9341-14df28c70286 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:24.975540 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1e018789-e60a-4e98-9341-14df28c70286 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:24.976528 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1e018789-e60a-4e98-9341-14df28c70286 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:24.977106 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1e018789-e60a-4e98-9341-14df28c70286 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:25.042889 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-c918e338-5cee-49be-b945-e05ffaa3a789 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'create', calling method: .version_select at 0x7f2dad4f9a60>, body: {"keypair": {"name": "tempest-keypair-2104450247"}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:24:25.109398 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-c918e338-5cee-49be-b945-e05ffaa3a789 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Getting quotas for project 8abd5d5840ac400c82604d0212b124f2. Resources: {'key_pairs'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:24:25.118409 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-c918e338-5cee-49be-b945-e05ffaa3a789 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Getting quotas for user 7036f594f5e1419a8f12e6657de1ffb9 and project 8abd5d5840ac400c82604d0212b124f2. Resources: {'key_pairs'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:24:25.152598 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-1e018789-e60a-4e98-9341-14df28c70286 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:25.166509 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-1e018789-e60a-4e98-9341-14df28c70286 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 200 len: 1286 microversion: 2.1 time: 0.211887 Nov 20 03:24:25.167088 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 17/40] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:24 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 1286 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:24:25.205472 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-c3a6b47a-c20b-4f6c-aead-c73887567e6a tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] Calling method '.version_select at 0x7f2dad4ff0d0>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:25.388135 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.wsgi [None req-c3a6b47a-c20b-4f6c-aead-c73887567e6a tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] HTTP exception thrown: Snapshot 1dabe139-7272-4eb5-9d23-8a02ea6f4938 could not be found. Nov 20 03:24:25.388735 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-c3a6b47a-c20b-4f6c-aead-c73887567e6a tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] Returning 404 to user: Snapshot 1dabe139-7272-4eb5-9d23-8a02ea6f4938 could not be found. {{(pid=116113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:24:25.389559 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-c3a6b47a-c20b-4f6c-aead-c73887567e6a tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/1dabe139-7272-4eb5-9d23-8a02ea6f4938" status: 404 len: 111 microversion: 2.1 time: 0.188914 Nov 20 03:24:25.390682 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 18/41] 10.222.0.37 () {58 vars in 1250 bytes} [Sat Nov 20 03:24:25 2021] GET /compute/v2.1/os-snapshots/1dabe139-7272-4eb5-9d23-8a02ea6f4938 => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 03:24:25.399117 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-eead8c83-bd4d-4404-8e7a-95b4fc3b7674 tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] Calling method '.version_select at 0x7f2dad4a7c10>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:25.637911 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-eead8c83-bd4d-4404-8e7a-95b4fc3b7674 tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/371f7448-9777-44b8-afcf-ed7326145339" status: 202 len: 0 microversion: 2.1 time: 0.242290 Nov 20 03:24:25.638447 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 19/42] 10.222.0.37 () {58 vars in 1247 bytes} [Sat Nov 20 03:24:25 2021] DELETE /compute/v2.1/os-volumes/371f7448-9777-44b8-afcf-ed7326145339 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:24:25.643256 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-d900f1ff-d589-4a69-bdb4-7adb40f36f89 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:25.644077 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-d900f1ff-d589-4a69-bdb4-7adb40f36f89 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:25.662481 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d900f1ff-d589-4a69-bdb4-7adb40f36f89 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:25.662961 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d900f1ff-d589-4a69-bdb4-7adb40f36f89 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:25.663753 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d900f1ff-d589-4a69-bdb4-7adb40f36f89 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:25.671936 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d900f1ff-d589-4a69-bdb4-7adb40f36f89 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:25.860603 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-d900f1ff-d589-4a69-bdb4-7adb40f36f89 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:25.885203 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-d900f1ff-d589-4a69-bdb4-7adb40f36f89 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1273 microversion: 2.1 time: 0.241690 Nov 20 03:24:25.885993 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 20/43] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:25 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1273 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:25.904880 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-19e7e9ae-2670-470e-a106-038c0987ca41 tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] Calling method '.version_select at 0x7f2dad4a7790>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:25.977241 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.wsgi [None req-19e7e9ae-2670-470e-a106-038c0987ca41 tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] HTTP exception thrown: Volume 371f7448-9777-44b8-afcf-ed7326145339 could not be found. Nov 20 03:24:25.977849 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-19e7e9ae-2670-470e-a106-038c0987ca41 tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] Returning 404 to user: Volume 371f7448-9777-44b8-afcf-ed7326145339 could not be found. {{(pid=116113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:24:25.978647 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-19e7e9ae-2670-470e-a106-038c0987ca41 tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/371f7448-9777-44b8-afcf-ed7326145339" status: 404 len: 109 microversion: 2.1 time: 0.091356 Nov 20 03:24:25.979193 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 21/44] 10.222.0.37 () {58 vars in 1244 bytes} [Sat Nov 20 03:24:25 2021] GET /compute/v2.1/os-volumes/371f7448-9777-44b8-afcf-ed7326145339 => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:24:25.992531 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-66837551-8e0b-4441-b150-6420a8d7189e tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] Calling method '.version_select at 0x7f2dad4638b0>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:26.032699 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.wsgi [None req-66837551-8e0b-4441-b150-6420a8d7189e tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] HTTP exception thrown: Volume 371f7448-9777-44b8-afcf-ed7326145339 could not be found. Nov 20 03:24:26.033463 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-66837551-8e0b-4441-b150-6420a8d7189e tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] Returning 404 to user: Volume 371f7448-9777-44b8-afcf-ed7326145339 could not be found. {{(pid=116113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:24:26.034596 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-66837551-8e0b-4441-b150-6420a8d7189e tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/371f7448-9777-44b8-afcf-ed7326145339" status: 404 len: 109 microversion: 2.1 time: 0.045866 Nov 20 03:24:26.035417 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 22/45] 10.222.0.37 () {58 vars in 1247 bytes} [Sat Nov 20 03:24:25 2021] DELETE /compute/v2.1/os-volumes/371f7448-9777-44b8-afcf-ed7326145339 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 03:24:26.043703 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ee56bc7a-8b2b-4f55-92cd-3468509783e0 tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] Calling method '.version_select at 0x7f2dad4a78b0>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:26.084908 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.wsgi [None req-ee56bc7a-8b2b-4f55-92cd-3468509783e0 tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] HTTP exception thrown: Volume 371f7448-9777-44b8-afcf-ed7326145339 could not be found. Nov 20 03:24:26.086406 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ee56bc7a-8b2b-4f55-92cd-3468509783e0 tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] Returning 404 to user: Volume 371f7448-9777-44b8-afcf-ed7326145339 could not be found. {{(pid=116113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:24:26.087753 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ee56bc7a-8b2b-4f55-92cd-3468509783e0 tempest-VolumesSnapshotsTestJSON-913918758 tempest-VolumesSnapshotsTestJSON-913918758-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/371f7448-9777-44b8-afcf-ed7326145339" status: 404 len: 109 microversion: 2.1 time: 0.048352 Nov 20 03:24:26.089007 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 23/46] 10.222.0.37 () {58 vars in 1244 bytes} [Sat Nov 20 03:24:26 2021] GET /compute/v2.1/os-volumes/371f7448-9777-44b8-afcf-ed7326145339 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:24:26.187634 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-b152c1d7-2621-42d3-b322-b35861ec04dc tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:26.190109 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-b152c1d7-2621-42d3-b322-b35861ec04dc tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:26.205001 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b152c1d7-2621-42d3-b322-b35861ec04dc tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:26.206215 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b152c1d7-2621-42d3-b322-b35861ec04dc tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:26.212253 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b152c1d7-2621-42d3-b322-b35861ec04dc tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:26.215459 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b152c1d7-2621-42d3-b322-b35861ec04dc tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:26.403721 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-c918e338-5cee-49be-b945-e05ffaa3a789 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Getting quotas for project 8abd5d5840ac400c82604d0212b124f2. Resources: {'key_pairs'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:24:26.417106 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-c918e338-5cee-49be-b945-e05ffaa3a789 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Getting quotas for user 7036f594f5e1419a8f12e6657de1ffb9 and project 8abd5d5840ac400c82604d0212b124f2. Resources: {'key_pairs'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:24:26.460359 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-c918e338-5cee-49be-b945-e05ffaa3a789 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 1.898436 Nov 20 03:24:26.466250 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 24/47] 10.222.0.37 () {62 vars in 1198 bytes} [Sat Nov 20 03:24:24 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1905 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 20 03:24:26.902603 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-90371b72-eadc-437f-b6c6-87f439246468 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:26.908545 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-90371b72-eadc-437f-b6c6-87f439246468 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:26.933639 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-90371b72-eadc-437f-b6c6-87f439246468 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:26.935879 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-90371b72-eadc-437f-b6c6-87f439246468 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:26.971987 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-90371b72-eadc-437f-b6c6-87f439246468 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:26.979243 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-90371b72-eadc-437f-b6c6-87f439246468 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:27.045221 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-b152c1d7-2621-42d3-b322-b35861ec04dc tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:27.058298 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-b152c1d7-2621-42d3-b322-b35861ec04dc tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 200 len: 1274 microversion: 2.1 time: 0.874578 Nov 20 03:24:27.060228 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 24/48] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:26 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 1274 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:27.756776 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-90371b72-eadc-437f-b6c6-87f439246468 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:27.790400 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-90371b72-eadc-437f-b6c6-87f439246468 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1273 microversion: 2.1 time: 0.886472 Nov 20 03:24:27.791582 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 25/49] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:26 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1273 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:28.078484 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-35b35036-5802-4593-9f62-1513bcc77159 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:28.079299 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-35b35036-5802-4593-9f62-1513bcc77159 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:28.100512 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-35b35036-5802-4593-9f62-1513bcc77159 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:28.102242 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-35b35036-5802-4593-9f62-1513bcc77159 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:28.105933 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-35b35036-5802-4593-9f62-1513bcc77159 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:28.108429 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-35b35036-5802-4593-9f62-1513bcc77159 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:28.114806 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-8f58bae7-612e-464e-ad85-6f19ae88b703 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1361066712", "imageRef": "e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d2470cf7-b23b-4542-91b2-b6ec415686c1"}]}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:24:28.268816 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-35b35036-5802-4593-9f62-1513bcc77159 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:28.281030 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-35b35036-5802-4593-9f62-1513bcc77159 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 200 len: 1274 microversion: 2.1 time: 0.208337 Nov 20 03:24:28.287610 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 26/50] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:28 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 1274 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:28.288775 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.network.neutron [None req-8f58bae7-612e-464e-ad85-6f19ae88b703 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] validate_networks() for [('d2470cf7-b23b-4542-91b2-b6ec415686c1', None, None, None, None, None)] {{(pid=116113) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 03:24:28.811857 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-7d16ef80-5e82-42ee-bee4-01eeae01c1b4 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:28.812498 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-7d16ef80-5e82-42ee-bee4-01eeae01c1b4 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:28.845940 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7d16ef80-5e82-42ee-bee4-01eeae01c1b4 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:28.847973 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7d16ef80-5e82-42ee-bee4-01eeae01c1b4 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:28.853112 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7d16ef80-5e82-42ee-bee4-01eeae01c1b4 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:28.856242 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7d16ef80-5e82-42ee-bee4-01eeae01c1b4 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:29.447833 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-7d16ef80-5e82-42ee-bee4-01eeae01c1b4 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:29.472756 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-7d16ef80-5e82-42ee-bee4-01eeae01c1b4 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1273 microversion: 2.1 time: 0.656678 Nov 20 03:24:29.486496 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 27/51] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:28 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1273 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:29.500584 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-5ec4ec32-607f-46d3-a3d0-dc944a85b5b9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:29.502178 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-5ec4ec32-607f-46d3-a3d0-dc944a85b5b9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:29.523148 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5ec4ec32-607f-46d3-a3d0-dc944a85b5b9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:29.523975 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5ec4ec32-607f-46d3-a3d0-dc944a85b5b9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:29.525627 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5ec4ec32-607f-46d3-a3d0-dc944a85b5b9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:29.526749 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5ec4ec32-607f-46d3-a3d0-dc944a85b5b9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:29.697745 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-5ec4ec32-607f-46d3-a3d0-dc944a85b5b9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:29.710295 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-5ec4ec32-607f-46d3-a3d0-dc944a85b5b9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 200 len: 1274 microversion: 2.1 time: 0.218913 Nov 20 03:24:29.710892 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 28/52] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:29 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 1274 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:30.492556 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-76ac90f7-716c-4804-9693-b6593a7efc8d tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:30.493898 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-76ac90f7-716c-4804-9693-b6593a7efc8d tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:30.514513 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-76ac90f7-716c-4804-9693-b6593a7efc8d tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:30.516208 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-76ac90f7-716c-4804-9693-b6593a7efc8d tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:30.523545 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-76ac90f7-716c-4804-9693-b6593a7efc8d tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:30.524032 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-76ac90f7-716c-4804-9693-b6593a7efc8d tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:30.967625 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-8f58bae7-612e-464e-ad85-6f19ae88b703 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Flavor limits 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 03:24:30.968301 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-8f58bae7-612e-464e-ad85-6f19ae88b703 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Image limits 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 03:24:30.968792 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-8f58bae7-612e-464e-ad85-6f19ae88b703 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Flavor pref 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 03:24:30.969205 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-8f58bae7-612e-464e-ad85-6f19ae88b703 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Image pref 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 03:24:30.969623 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-8f58bae7-612e-464e-ad85-6f19ae88b703 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 03:24:30.982238 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8f58bae7-612e-464e-ad85-6f19ae88b703 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:30.984534 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8f58bae7-612e-464e-ad85-6f19ae88b703 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:30.986633 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8f58bae7-612e-464e-ad85-6f19ae88b703 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:30.987461 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8f58bae7-612e-464e-ad85-6f19ae88b703 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:31.101990 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-8f58bae7-612e-464e-ad85-6f19ae88b703 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Getting quotas for project 15b3ce6068f54d3f97b14f94f674223b. Resources: {'ram', 'cores', 'instances'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:24:31.128609 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-8f58bae7-612e-464e-ad85-6f19ae88b703 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Getting quotas for user 71169193963848168fee643c10ecdf83 and project 15b3ce6068f54d3f97b14f94f674223b. Resources: {'ram', 'cores', 'instances'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:24:31.170062 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-8f58bae7-612e-464e-ad85-6f19ae88b703 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Going to run 1 instances... {{(pid=116113) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 03:24:31.179693 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-8f58bae7-612e-464e-ad85-6f19ae88b703 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 03:24:31.324565 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-8f58bae7-612e-464e-ad85-6f19ae88b703 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.576246 Nov 20 03:24:31.329942 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 25/53] 10.222.0.37 () {60 vars in 1146 bytes} [Sat Nov 20 03:24:27 2021] POST /compute/v2.1/servers => generated 383 bytes in 3582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 20 03:24:31.343351 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-6527b1be-6361-4a97-9880-3349d005e99c tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:31.345631 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-6527b1be-6361-4a97-9880-3349d005e99c tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:31.359345 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6527b1be-6361-4a97-9880-3349d005e99c tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:31.363147 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6527b1be-6361-4a97-9880-3349d005e99c tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:31.364290 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6527b1be-6361-4a97-9880-3349d005e99c tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:31.367741 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6527b1be-6361-4a97-9880-3349d005e99c tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:31.608780 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-76ac90f7-716c-4804-9693-b6593a7efc8d tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:31.618388 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-76ac90f7-716c-4804-9693-b6593a7efc8d tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1315 microversion: 2.1 time: 1.129607 Nov 20 03:24:31.634138 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 29/54] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:30 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1315 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:24:31.658301 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-5d7f8ad4-3a33-4dc2-a953-c247a7d439fc tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:31.659888 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-5d7f8ad4-3a33-4dc2-a953-c247a7d439fc tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:31.980449 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-6527b1be-6361-4a97-9880-3349d005e99c tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:31.993194 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-6527b1be-6361-4a97-9880-3349d005e99c tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 200 len: 1316 microversion: 2.1 time: 0.661779 Nov 20 03:24:31.993820 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 26/55] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:31 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 1316 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:32.056456 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-5d7f8ad4-3a33-4dc2-a953-c247a7d439fc tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:32.091397 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-5d7f8ad4-3a33-4dc2-a953-c247a7d439fc tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1222 microversion: 2.1 time: 0.453687 Nov 20 03:24:32.113023 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 30/56] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:31 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1222 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:32.174999 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-4b4c5adf-d60f-4f55-9eb1-2dd295713e26 tempest-VolumesTestJSON-539465970 tempest-VolumesTestJSON-539465970-project] Calling method '.version_select at 0x7f2dad4ff790>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:32.323932 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-4b4c5adf-d60f-4f55-9eb1-2dd295713e26 tempest-VolumesTestJSON-539465970 tempest-VolumesTestJSON-539465970-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/6400f75e-bb9f-4bb6-a854-1776426decac" status: 200 len: 350 microversion: 2.1 time: 0.152667 Nov 20 03:24:32.330933 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 27/57] 10.222.0.37 () {58 vars in 1244 bytes} [Sat Nov 20 03:24:32 2021] GET /compute/v2.1/os-volumes/6400f75e-bb9f-4bb6-a854-1776426decac => generated 350 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:24:32.641060 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-dd494d56-ee4f-42a6-8144-88c090bbe3ad tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:32.642069 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-dd494d56-ee4f-42a6-8144-88c090bbe3ad tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:32.662901 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dd494d56-ee4f-42a6-8144-88c090bbe3ad tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:32.664619 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dd494d56-ee4f-42a6-8144-88c090bbe3ad tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:32.672518 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dd494d56-ee4f-42a6-8144-88c090bbe3ad tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:32.676129 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dd494d56-ee4f-42a6-8144-88c090bbe3ad tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:32.694112 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-7b2e0e27-4981-4419-a9b5-4702945230c7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2006455376", "imageRef": "e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d2470cf7-b23b-4542-91b2-b6ec415686c1"}]}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:24:32.825734 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.network.neutron [None req-7b2e0e27-4981-4419-a9b5-4702945230c7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] validate_networks() for [('d2470cf7-b23b-4542-91b2-b6ec415686c1', None, None, None, None, None)] {{(pid=116113) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 03:24:33.711077 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-dd494d56-ee4f-42a6-8144-88c090bbe3ad tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:33.732014 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-dd494d56-ee4f-42a6-8144-88c090bbe3ad tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1315 microversion: 2.1 time: 1.097009 Nov 20 03:24:33.737448 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 31/58] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:32 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1315 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:33.770203 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-7369c41f-c9d9-46a9-8966-8a6d4792d833 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:33.775187 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-7369c41f-c9d9-46a9-8966-8a6d4792d833 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:33.793724 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7369c41f-c9d9-46a9-8966-8a6d4792d833 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:33.794545 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7369c41f-c9d9-46a9-8966-8a6d4792d833 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:33.796179 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7369c41f-c9d9-46a9-8966-8a6d4792d833 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:33.798755 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7369c41f-c9d9-46a9-8966-8a6d4792d833 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:35.175417 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-7369c41f-c9d9-46a9-8966-8a6d4792d833 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:35.185690 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-7369c41f-c9d9-46a9-8966-8a6d4792d833 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 200 len: 1316 microversion: 2.1 time: 1.444649 Nov 20 03:24:35.186438 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 32/59] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:33 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 1316 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:35.196836 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-6e2ef661-8134-4123-9028-56fd73190765 tempest-VolumesTestJSON-539465970 tempest-VolumesTestJSON-539465970-project] Calling method '.version_select at 0x7f2dad4b9f70>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:35.429234 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-6e2ef661-8134-4123-9028-56fd73190765 tempest-VolumesTestJSON-539465970 tempest-VolumesTestJSON-539465970-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/c2c23476-28fc-439b-b538-cc5598d80482" status: 200 len: 351 microversion: 2.1 time: 0.241678 Nov 20 03:24:35.429797 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 33/60] 10.222.0.37 () {58 vars in 1244 bytes} [Sat Nov 20 03:24:35 2021] GET /compute/v2.1/os-volumes/c2c23476-28fc-439b-b538-cc5598d80482 => generated 351 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:24:35.434880 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-7957b098-b530-4610-9e5e-eb790a19b18b tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:35.435536 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-7957b098-b530-4610-9e5e-eb790a19b18b tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:35.458051 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7957b098-b530-4610-9e5e-eb790a19b18b tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:35.458513 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7957b098-b530-4610-9e5e-eb790a19b18b tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:35.471887 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7957b098-b530-4610-9e5e-eb790a19b18b tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:35.472756 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7957b098-b530-4610-9e5e-eb790a19b18b tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:36.337442 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-7b2e0e27-4981-4419-a9b5-4702945230c7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Flavor limits 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 03:24:36.338593 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-7b2e0e27-4981-4419-a9b5-4702945230c7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Image limits 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 03:24:36.339148 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-7b2e0e27-4981-4419-a9b5-4702945230c7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Flavor pref 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 03:24:36.339623 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-7b2e0e27-4981-4419-a9b5-4702945230c7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Image pref 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 03:24:36.340167 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-7b2e0e27-4981-4419-a9b5-4702945230c7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 03:24:36.367658 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7b2e0e27-4981-4419-a9b5-4702945230c7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:36.369058 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7b2e0e27-4981-4419-a9b5-4702945230c7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:36.374312 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7b2e0e27-4981-4419-a9b5-4702945230c7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:36.377006 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7b2e0e27-4981-4419-a9b5-4702945230c7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:36.488446 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-7b2e0e27-4981-4419-a9b5-4702945230c7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Getting quotas for project 15b3ce6068f54d3f97b14f94f674223b. Resources: {'ram', 'cores', 'instances'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:24:36.515521 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-7b2e0e27-4981-4419-a9b5-4702945230c7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Getting quotas for user 71169193963848168fee643c10ecdf83 and project 15b3ce6068f54d3f97b14f94f674223b. Resources: {'ram', 'cores', 'instances'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:24:36.575037 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-7b2e0e27-4981-4419-a9b5-4702945230c7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Going to run 1 instances... {{(pid=116113) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 03:24:36.583119 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-7b2e0e27-4981-4419-a9b5-4702945230c7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 03:24:36.624992 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-7957b098-b530-4610-9e5e-eb790a19b18b tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:36.647243 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-7957b098-b530-4610-9e5e-eb790a19b18b tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1315 microversion: 2.1 time: 1.212232 Nov 20 03:24:36.648847 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 34/61] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:35 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1315 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:36.759072 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-7b2e0e27-4981-4419-a9b5-4702945230c7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.069179 Nov 20 03:24:36.761788 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 28/62] 10.222.0.37 () {60 vars in 1146 bytes} [Sat Nov 20 03:24:32 2021] POST /compute/v2.1/servers => generated 383 bytes in 4072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 03:24:36.772595 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-2d115292-0e17-4aab-9c10-6e79a87ab11a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:36.775404 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-2d115292-0e17-4aab-9c10-6e79a87ab11a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:36.791156 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2d115292-0e17-4aab-9c10-6e79a87ab11a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:36.796337 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2d115292-0e17-4aab-9c10-6e79a87ab11a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:36.796337 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2d115292-0e17-4aab-9c10-6e79a87ab11a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:36.796337 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2d115292-0e17-4aab-9c10-6e79a87ab11a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:36.962795 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-f0b881b8-8985-4568-9cda-30e21df5dc2b req-15c76703-6fdd-41bf-8364-e017841b4988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b039039-82f2-411a-8b2f-39e31df51f77", "tag": "6cabe651-4a25-4e86-bfd6-a1e07df36346"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:24:36.965622 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:24:36.965622 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:24:37.000851 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-f0b881b8-8985-4568-9cda-30e21df5dc2b req-15c76703-6fdd-41bf-8364-e017841b4988 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:37.003322 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-f0b881b8-8985-4568-9cda-30e21df5dc2b req-15c76703-6fdd-41bf-8364-e017841b4988 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:37.089297 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-f0b881b8-8985-4568-9cda-30e21df5dc2b req-15c76703-6fdd-41bf-8364-e017841b4988 service nova] Creating event network-changed:6cabe651-4a25-4e86-bfd6-a1e07df36346 for instance 3b039039-82f2-411a-8b2f-39e31df51f77 on hv-cinder-81803 Nov 20 03:24:37.089828 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-f0b881b8-8985-4568-9cda-30e21df5dc2b req-15c76703-6fdd-41bf-8364-e017841b4988 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116114) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 20 03:24:37.092376 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-31605b61-79e4-401f-93b2-f6754be2276a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:37.095667 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-31605b61-79e4-401f-93b2-f6754be2276a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:37.100473 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-31605b61-79e4-401f-93b2-f6754be2276a None None] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:37.100917 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-31605b61-79e4-401f-93b2-f6754be2276a None None] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:37.150258 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.compute.rpcapi [None req-31605b61-79e4-401f-93b2-f6754be2276a None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 20 03:24:37.153876 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-31605b61-79e4-401f-93b2-f6754be2276a None None] Releasing lock "compute-rpcapi-router" {{(pid=116114) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 20 03:24:37.250773 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-31605b61-79e4-401f-93b2-f6754be2276a None None] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.600606 Nov 20 03:24:37.251707 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 35/63] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:24:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:24:37.812416 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-2d115292-0e17-4aab-9c10-6e79a87ab11a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:37.821224 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-2d115292-0e17-4aab-9c10-6e79a87ab11a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 200 len: 1316 microversion: 2.1 time: 1.058382 Nov 20 03:24:37.827112 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 29/64] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:36 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 1316 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:37.835440 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-eb4f88e6-6600-448c-a957-d584de0c557d req-3d9dd792-6b7b-4f9c-8fdb-117ae9c03344 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "459573a2-39ec-47c3-8815-297d17954f29", "tag": "aabfdd18-ae62-4c81-b28d-067cee7510cd"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:24:37.837179 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:24:37.837179 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:24:37.844976 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-334b2762-aec1-4783-ba90-1cb98826233f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:37.851554 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-334b2762-aec1-4783-ba90-1cb98826233f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:37.859976 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-eb4f88e6-6600-448c-a957-d584de0c557d req-3d9dd792-6b7b-4f9c-8fdb-117ae9c03344 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:37.861774 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-eb4f88e6-6600-448c-a957-d584de0c557d req-3d9dd792-6b7b-4f9c-8fdb-117ae9c03344 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:37.867873 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-334b2762-aec1-4783-ba90-1cb98826233f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:37.871948 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-334b2762-aec1-4783-ba90-1cb98826233f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:37.874474 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-334b2762-aec1-4783-ba90-1cb98826233f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:37.877501 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-334b2762-aec1-4783-ba90-1cb98826233f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:37.920808 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-eb4f88e6-6600-448c-a957-d584de0c557d req-3d9dd792-6b7b-4f9c-8fdb-117ae9c03344 service nova] Creating event network-changed:aabfdd18-ae62-4c81-b28d-067cee7510cd for instance 459573a2-39ec-47c3-8815-297d17954f29 on hv-cinder-81803 Nov 20 03:24:37.960420 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-eb4f88e6-6600-448c-a957-d584de0c557d req-3d9dd792-6b7b-4f9c-8fdb-117ae9c03344 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.699938 Nov 20 03:24:37.961103 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 36/65] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:24:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:24:37.991936 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-20b2797c-62f7-4318-a2ae-a9358aedd6b6 tempest-VolumesTestJSON-539465970 tempest-VolumesTestJSON-539465970-project] Calling method '.version_select at 0x7f2dad508c10>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:38.235604 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-334b2762-aec1-4783-ba90-1cb98826233f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:38.249088 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-334b2762-aec1-4783-ba90-1cb98826233f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1226 microversion: 2.1 time: 0.414487 Nov 20 03:24:38.251855 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 30/66] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:37 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1226 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:38.266527 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-406be468-1a50-4809-9221-610c0e4c8a28 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:38.269927 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-406be468-1a50-4809-9221-610c0e4c8a28 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:38.287543 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-406be468-1a50-4809-9221-610c0e4c8a28 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:38.292519 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-406be468-1a50-4809-9221-610c0e4c8a28 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:38.294174 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-406be468-1a50-4809-9221-610c0e4c8a28 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:38.297663 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-406be468-1a50-4809-9221-610c0e4c8a28 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:38.493685 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-20b2797c-62f7-4318-a2ae-a9358aedd6b6 tempest-VolumesTestJSON-539465970 tempest-VolumesTestJSON-539465970-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/07a7ebf2-892d-46cf-b098-2718ab5fc06b" status: 200 len: 350 microversion: 2.1 time: 0.531304 Nov 20 03:24:38.494936 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 37/67] 10.222.0.37 () {58 vars in 1244 bytes} [Sat Nov 20 03:24:37 2021] GET /compute/v2.1/os-volumes/07a7ebf2-892d-46cf-b098-2718ab5fc06b => generated 350 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:24:38.507251 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-f5efe684-a9f1-4f50-9cf6-1a5d19cc87ef tempest-VolumesTestJSON-539465970 tempest-VolumesTestJSON-539465970-project] Calling method '.version_select at 0x7f2dacc8adc0>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:38.731408 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-f5efe684-a9f1-4f50-9cf6-1a5d19cc87ef tempest-VolumesTestJSON-539465970 tempest-VolumesTestJSON-539465970-project] 10.222.0.37 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.228073 Nov 20 03:24:38.740484 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 38/68] 10.222.0.37 () {58 vars in 1133 bytes} [Sat Nov 20 03:24:38 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:38.747707 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-6785d86c-6b13-46c5-abb3-651e823c8d4f tempest-VolumesTestJSON-539465970 tempest-VolumesTestJSON-539465970-project] Calling method '.version_select at 0x7f2dacc2caf0>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:38.778821 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-406be468-1a50-4809-9221-610c0e4c8a28 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:38.792489 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-406be468-1a50-4809-9221-610c0e4c8a28 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1315 microversion: 2.1 time: 0.539207 Nov 20 03:24:38.806171 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 31/69] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:38 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:38.844178 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-71d8d3ba-3c6a-4071-8a50-c9821d800487 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:38.844874 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-71d8d3ba-3c6a-4071-8a50-c9821d800487 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:38.855927 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-71d8d3ba-3c6a-4071-8a50-c9821d800487 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:38.856149 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-71d8d3ba-3c6a-4071-8a50-c9821d800487 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:38.861425 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-71d8d3ba-3c6a-4071-8a50-c9821d800487 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:38.861968 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-71d8d3ba-3c6a-4071-8a50-c9821d800487 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:39.313021 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-6785d86c-6b13-46c5-abb3-651e823c8d4f tempest-VolumesTestJSON-539465970 tempest-VolumesTestJSON-539465970-project] 10.222.0.37 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.570573 Nov 20 03:24:39.314181 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 39/70] 10.222.0.37 () {58 vars in 1148 bytes} [Sat Nov 20 03:24:38 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:24:39.320273 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-321eb423-3324-4891-9967-03513cc3eabe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-389714562", "imageRef": "e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3ac0da1c-dc79-4675-9f0a-2d0c06da492e"}], "security_groups": [{"name": "tempest-securitygroup--1360329176"}], "key_name": "tempest-keypair-2104450247", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:24:39.697156 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.network.neutron [None req-321eb423-3324-4891-9967-03513cc3eabe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] validate_networks() for [('3ac0da1c-dc79-4675-9f0a-2d0c06da492e', None, None, None, None, None)] {{(pid=116114) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 03:24:39.746916 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-71d8d3ba-3c6a-4071-8a50-c9821d800487 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:39.760829 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-71d8d3ba-3c6a-4071-8a50-c9821d800487 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 200 len: 1316 microversion: 2.1 time: 0.919645 Nov 20 03:24:39.761342 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 32/71] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:38 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 1316 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:24:39.773465 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-a4ec692f-76a7-4654-baf5-55df0d373754 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:39.774198 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-a4ec692f-76a7-4654-baf5-55df0d373754 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:39.795340 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a4ec692f-76a7-4654-baf5-55df0d373754 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:39.796049 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a4ec692f-76a7-4654-baf5-55df0d373754 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:39.796853 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a4ec692f-76a7-4654-baf5-55df0d373754 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:39.797336 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a4ec692f-76a7-4654-baf5-55df0d373754 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:39.985465 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a4ec692f-76a7-4654-baf5-55df0d373754 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:39.996412 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-a4ec692f-76a7-4654-baf5-55df0d373754 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1274 microversion: 2.1 time: 0.233828 Nov 20 03:24:39.997183 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 33/72] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:39 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1274 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:40.012378 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-8ae6ed99-8c28-451f-8c9c-0866510056b0 tempest-VolumesTestJSON-539465970 tempest-VolumesTestJSON-539465970-project] Calling method '.version_select at 0x7f2dad4a99d0>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:40.180520 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-8ae6ed99-8c28-451f-8c9c-0866510056b0 tempest-VolumesTestJSON-539465970 tempest-VolumesTestJSON-539465970-project] 10.222.0.37 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.182304 Nov 20 03:24:40.181086 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 34/73] 10.222.0.37 () {58 vars in 1133 bytes} [Sat Nov 20 03:24:39 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:40.193125 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-724087be-d0dc-447e-a5f2-a8d0ec8382cc tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:40.194129 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-724087be-d0dc-447e-a5f2-a8d0ec8382cc tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:40.206095 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-724087be-d0dc-447e-a5f2-a8d0ec8382cc tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:40.206959 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-724087be-d0dc-447e-a5f2-a8d0ec8382cc tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:40.208217 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-724087be-d0dc-447e-a5f2-a8d0ec8382cc tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:40.209325 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-724087be-d0dc-447e-a5f2-a8d0ec8382cc tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:40.438110 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-724087be-d0dc-447e-a5f2-a8d0ec8382cc tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:40.451653 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-724087be-d0dc-447e-a5f2-a8d0ec8382cc tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1315 microversion: 2.1 time: 0.262338 Nov 20 03:24:40.452707 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 35/74] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:40 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:40.458669 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-536c3752-1bfe-42ec-8621-24c0c4403750 tempest-VolumesTestJSON-539465970 tempest-VolumesTestJSON-539465970-project] Calling method '.version_select at 0x7f2dad4a99d0>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:40.473930 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-321eb423-3324-4891-9967-03513cc3eabe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Flavor limits 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 03:24:40.475481 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-321eb423-3324-4891-9967-03513cc3eabe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Image limits 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 03:24:40.475984 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-321eb423-3324-4891-9967-03513cc3eabe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Flavor pref 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 03:24:40.478165 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-321eb423-3324-4891-9967-03513cc3eabe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Image pref 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 03:24:40.479145 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-321eb423-3324-4891-9967-03513cc3eabe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 03:24:40.499575 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-321eb423-3324-4891-9967-03513cc3eabe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:40.501983 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-321eb423-3324-4891-9967-03513cc3eabe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:40.502969 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-321eb423-3324-4891-9967-03513cc3eabe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:40.504930 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-321eb423-3324-4891-9967-03513cc3eabe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:40.582486 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-321eb423-3324-4891-9967-03513cc3eabe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Getting quotas for project 8abd5d5840ac400c82604d0212b124f2. Resources: {'ram', 'cores', 'instances'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:24:40.591627 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-321eb423-3324-4891-9967-03513cc3eabe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Getting quotas for user 7036f594f5e1419a8f12e6657de1ffb9 and project 8abd5d5840ac400c82604d0212b124f2. Resources: {'ram', 'cores', 'instances'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:24:40.626735 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-321eb423-3324-4891-9967-03513cc3eabe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Going to run 1 instances... {{(pid=116114) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 03:24:40.629015 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-536c3752-1bfe-42ec-8621-24c0c4403750 tempest-VolumesTestJSON-539465970 tempest-VolumesTestJSON-539465970-project] 10.222.0.37 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.175065 Nov 20 03:24:40.629337 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-321eb423-3324-4891-9967-03513cc3eabe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 03:24:40.630335 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 36/75] 10.222.0.37 () {58 vars in 1166 bytes} [Sat Nov 20 03:24:40 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:24:40.642103 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-c5be1112-2760-4ab0-b59a-21af89466439 tempest-VolumesTestJSON-539465970 tempest-VolumesTestJSON-539465970-project] Calling method '.version_select at 0x7f2dad4a73a0>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:40.729540 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-321eb423-3324-4891-9967-03513cc3eabe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.412564 Nov 20 03:24:40.732254 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 40/76] 10.222.0.37 () {62 vars in 1187 bytes} [Sat Nov 20 03:24:39 2021] POST /compute/v2.1/servers => generated 402 bytes in 1417 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 20 03:24:40.742844 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-c5be1112-2760-4ab0-b59a-21af89466439 tempest-VolumesTestJSON-539465970 tempest-VolumesTestJSON-539465970-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.104739 Nov 20 03:24:40.743847 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-c86752a5-ad25-442b-9d04-931c09f0255c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:40.744523 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-c86752a5-ad25-442b-9d04-931c09f0255c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:40.746677 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 37/77] 10.222.0.37 () {58 vars in 1169 bytes} [Sat Nov 20 03:24:40 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:24:40.770503 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-dd6cbec2-2489-436e-9792-88522d05759d tempest-VolumesTestJSON-539465970 tempest-VolumesTestJSON-539465970-project] Calling method '.version_select at 0x7f2dad4ff670>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:40.919077 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-c86752a5-ad25-442b-9d04-931c09f0255c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:40.931431 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-c86752a5-ad25-442b-9d04-931c09f0255c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:40.933592 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-c86752a5-ad25-442b-9d04-931c09f0255c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:40.935808 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-c86752a5-ad25-442b-9d04-931c09f0255c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1281 microversion: 2.20 time: 0.197902 Nov 20 03:24:40.940093 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 41/78] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:24:40 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1281 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:24:40.951270 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-70ecb96b-58b8-4135-adab-b9097a38708f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:40.951984 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-70ecb96b-58b8-4135-adab-b9097a38708f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:40.965737 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-70ecb96b-58b8-4135-adab-b9097a38708f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:40.966846 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-70ecb96b-58b8-4135-adab-b9097a38708f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:40.967509 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-70ecb96b-58b8-4135-adab-b9097a38708f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:40.968900 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-70ecb96b-58b8-4135-adab-b9097a38708f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:41.151174 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-dd6cbec2-2489-436e-9792-88522d05759d tempest-VolumesTestJSON-539465970 tempest-VolumesTestJSON-539465970-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.390403 Nov 20 03:24:41.153887 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 38/79] 10.222.0.37 () {58 vars in 1154 bytes} [Sat Nov 20 03:24:40 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:41.166180 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-fd2e285f-01c5-44fd-a25b-f334337e5643 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:41.168571 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-fd2e285f-01c5-44fd-a25b-f334337e5643 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:41.177471 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fd2e285f-01c5-44fd-a25b-f334337e5643 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:41.178042 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fd2e285f-01c5-44fd-a25b-f334337e5643 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:41.178935 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fd2e285f-01c5-44fd-a25b-f334337e5643 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:41.179439 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fd2e285f-01c5-44fd-a25b-f334337e5643 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:41.360997 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-fd2e285f-01c5-44fd-a25b-f334337e5643 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:41.369036 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-fd2e285f-01c5-44fd-a25b-f334337e5643 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1274 microversion: 2.1 time: 0.212524 Nov 20 03:24:41.369762 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 39/80] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:41 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1274 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:41.374453 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-9852f553-4f1c-45c7-9781-09176aad08be tempest-VolumesTestJSON-539465970 tempest-VolumesTestJSON-539465970-project] Calling method '.version_select at 0x7f2dad4ff310>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:41.465045 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-70ecb96b-58b8-4135-adab-b9097a38708f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:41.468406 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-9852f553-4f1c-45c7-9781-09176aad08be tempest-VolumesTestJSON-539465970 tempest-VolumesTestJSON-539465970-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.096503 Nov 20 03:24:41.469270 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 40/81] 10.222.0.37 () {58 vars in 1187 bytes} [Sat Nov 20 03:24:41 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:24:41.474882 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-70ecb96b-58b8-4135-adab-b9097a38708f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 200 len: 1316 microversion: 2.1 time: 0.536322 Nov 20 03:24:41.476555 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 42/82] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:40 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 1316 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:41.476942 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-0a887fc2-4808-46d9-ae83-790591f8d989 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:41.477599 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-0a887fc2-4808-46d9-ae83-790591f8d989 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:41.481813 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-bfbfb44c-a17f-4300-b0c1-569087d34b0f tempest-VolumesTestJSON-539465970 tempest-VolumesTestJSON-539465970-project] Calling method '.version_select at 0x7f2dacc2cf70>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:41.484282 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0a887fc2-4808-46d9-ae83-790591f8d989 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:41.484738 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0a887fc2-4808-46d9-ae83-790591f8d989 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:41.485585 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0a887fc2-4808-46d9-ae83-790591f8d989 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:41.486018 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0a887fc2-4808-46d9-ae83-790591f8d989 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:41.586108 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-bfbfb44c-a17f-4300-b0c1-569087d34b0f tempest-VolumesTestJSON-539465970 tempest-VolumesTestJSON-539465970-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.108081 Nov 20 03:24:41.587113 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 43/83] 10.222.0.37 () {58 vars in 1154 bytes} [Sat Nov 20 03:24:41 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:41.649558 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-0a887fc2-4808-46d9-ae83-790591f8d989 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:41.660580 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-0a887fc2-4808-46d9-ae83-790591f8d989 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1315 microversion: 2.1 time: 0.189872 Nov 20 03:24:41.662848 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 41/84] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:41 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:41.955104 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-da3a80de-a736-480a-9257-d965c88c90c6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:41.955743 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-da3a80de-a736-480a-9257-d965c88c90c6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:41.965464 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-da3a80de-a736-480a-9257-d965c88c90c6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:41.966227 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-da3a80de-a736-480a-9257-d965c88c90c6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:41.968026 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-da3a80de-a736-480a-9257-d965c88c90c6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:41.968733 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-da3a80de-a736-480a-9257-d965c88c90c6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:42.050500 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-da3a80de-a736-480a-9257-d965c88c90c6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:42.058963 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-da3a80de-a736-480a-9257-d965c88c90c6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:42.061363 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-da3a80de-a736-480a-9257-d965c88c90c6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:42.062467 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-da3a80de-a736-480a-9257-d965c88c90c6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1277 microversion: 2.20 time: 0.111867 Nov 20 03:24:42.063334 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 44/85] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:24:41 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1277 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:24:42.385850 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-780679ff-ed65-4bf0-8478-5531c5e57e4d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:42.386454 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-780679ff-ed65-4bf0-8478-5531c5e57e4d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:42.402860 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-780679ff-ed65-4bf0-8478-5531c5e57e4d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:42.403322 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-780679ff-ed65-4bf0-8478-5531c5e57e4d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:42.404163 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-780679ff-ed65-4bf0-8478-5531c5e57e4d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:42.408031 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-780679ff-ed65-4bf0-8478-5531c5e57e4d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:42.494623 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-26a12adc-691f-495b-8061-979403b9b75e tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:42.495150 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-26a12adc-691f-495b-8061-979403b9b75e tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:42.505809 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-26a12adc-691f-495b-8061-979403b9b75e tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:42.508732 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-26a12adc-691f-495b-8061-979403b9b75e tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:42.515091 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-26a12adc-691f-495b-8061-979403b9b75e tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:42.515880 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-26a12adc-691f-495b-8061-979403b9b75e tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:42.586388 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-780679ff-ed65-4bf0-8478-5531c5e57e4d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:42.594383 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-780679ff-ed65-4bf0-8478-5531c5e57e4d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1282 microversion: 2.1 time: 0.212096 Nov 20 03:24:42.594957 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 42/86] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:42 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1282 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:42.679988 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-806ce8b9-8f05-416d-a4f2-1e9a51d9a27b tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:42.680866 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-806ce8b9-8f05-416d-a4f2-1e9a51d9a27b tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:42.692121 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-806ce8b9-8f05-416d-a4f2-1e9a51d9a27b tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:42.693948 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-806ce8b9-8f05-416d-a4f2-1e9a51d9a27b tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:42.697049 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-806ce8b9-8f05-416d-a4f2-1e9a51d9a27b tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:42.698893 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-806ce8b9-8f05-416d-a4f2-1e9a51d9a27b tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:43.082568 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-26a12adc-691f-495b-8061-979403b9b75e tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:43.093397 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-26a12adc-691f-495b-8061-979403b9b75e tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 200 len: 1316 microversion: 2.1 time: 0.602339 Nov 20 03:24:43.093909 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-806ce8b9-8f05-416d-a4f2-1e9a51d9a27b tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:43.096296 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 45/87] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:42 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 1316 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:43.103970 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-806ce8b9-8f05-416d-a4f2-1e9a51d9a27b tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1315 microversion: 2.1 time: 0.429113 Nov 20 03:24:43.106919 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 43/88] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:42 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:43.110335 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-e433a9c7-c4d2-4257-b739-28ce6821d0bf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:43.111127 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-e433a9c7-c4d2-4257-b739-28ce6821d0bf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:43.138698 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e433a9c7-c4d2-4257-b739-28ce6821d0bf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:43.140315 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e433a9c7-c4d2-4257-b739-28ce6821d0bf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:43.147637 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e433a9c7-c4d2-4257-b739-28ce6821d0bf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:43.148330 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e433a9c7-c4d2-4257-b739-28ce6821d0bf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:43.335456 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-e433a9c7-c4d2-4257-b739-28ce6821d0bf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:43.345554 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-e433a9c7-c4d2-4257-b739-28ce6821d0bf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:43.358333 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-e433a9c7-c4d2-4257-b739-28ce6821d0bf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:43.359835 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-e433a9c7-c4d2-4257-b739-28ce6821d0bf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1341 microversion: 2.20 time: 0.262340 Nov 20 03:24:43.360873 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 46/89] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:24:43 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1341 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:24:43.612634 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-2dd02f12-d427-428e-8a9d-deac05e4a75a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:43.613262 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-2dd02f12-d427-428e-8a9d-deac05e4a75a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:43.644534 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2dd02f12-d427-428e-8a9d-deac05e4a75a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:43.647135 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2dd02f12-d427-428e-8a9d-deac05e4a75a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:43.648931 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2dd02f12-d427-428e-8a9d-deac05e4a75a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:43.649549 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2dd02f12-d427-428e-8a9d-deac05e4a75a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:43.716813 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-db0f4805-e442-4409-8ce1-d6db1fca2554 req-06ba5f3a-bc03-4f37-935b-1a356255a690 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1520eab8-d6b9-48aa-8333-5c7758310e82", "tag": "04b72906-e641-41e4-a5a9-636c7cd117c9"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:24:43.719948 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:24:43.719948 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:24:43.731703 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-db0f4805-e442-4409-8ce1-d6db1fca2554 req-06ba5f3a-bc03-4f37-935b-1a356255a690 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:43.740368 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-db0f4805-e442-4409-8ce1-d6db1fca2554 req-06ba5f3a-bc03-4f37-935b-1a356255a690 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:43.755043 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-db0f4805-e442-4409-8ce1-d6db1fca2554 req-06ba5f3a-bc03-4f37-935b-1a356255a690 service nova] Creating event network-changed:04b72906-e641-41e4-a5a9-636c7cd117c9 for instance 1520eab8-d6b9-48aa-8333-5c7758310e82 on hv-cinder-81803 Nov 20 03:24:43.769619 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-db0f4805-e442-4409-8ce1-d6db1fca2554 req-06ba5f3a-bc03-4f37-935b-1a356255a690 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056661 Nov 20 03:24:43.770297 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 47/90] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:24:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:24:43.810109 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-2dd02f12-d427-428e-8a9d-deac05e4a75a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:43.825018 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-2dd02f12-d427-428e-8a9d-deac05e4a75a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1280 microversion: 2.1 time: 0.216797 Nov 20 03:24:43.828817 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 44/91] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:43 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1280 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:44.112318 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-b7bad002-0115-4196-892a-704f802c6a0b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:44.113675 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-b7bad002-0115-4196-892a-704f802c6a0b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:44.127108 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-a5887a73-5221-4a99-98ee-b4c4c0579462 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:44.128292 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-a5887a73-5221-4a99-98ee-b4c4c0579462 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:44.136266 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b7bad002-0115-4196-892a-704f802c6a0b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:44.139873 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b7bad002-0115-4196-892a-704f802c6a0b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:44.143255 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a5887a73-5221-4a99-98ee-b4c4c0579462 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:44.148414 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b7bad002-0115-4196-892a-704f802c6a0b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:44.149340 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a5887a73-5221-4a99-98ee-b4c4c0579462 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:44.149994 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b7bad002-0115-4196-892a-704f802c6a0b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:44.152844 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a5887a73-5221-4a99-98ee-b4c4c0579462 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:44.153486 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a5887a73-5221-4a99-98ee-b4c4c0579462 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:44.763359 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a5887a73-5221-4a99-98ee-b4c4c0579462 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:44.770687 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-a5887a73-5221-4a99-98ee-b4c4c0579462 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1315 microversion: 2.1 time: 0.647885 Nov 20 03:24:44.771269 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 45/92] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:44 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1315 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:24:44.784687 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-246469c6-e7d2-4101-a7c2-905fc0744df1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:44.785440 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-246469c6-e7d2-4101-a7c2-905fc0744df1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:44.794913 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-246469c6-e7d2-4101-a7c2-905fc0744df1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:44.795607 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-246469c6-e7d2-4101-a7c2-905fc0744df1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:44.796412 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-246469c6-e7d2-4101-a7c2-905fc0744df1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:44.796848 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-246469c6-e7d2-4101-a7c2-905fc0744df1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:44.901618 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-b7bad002-0115-4196-892a-704f802c6a0b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:44.910779 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-b7bad002-0115-4196-892a-704f802c6a0b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 200 len: 1316 microversion: 2.1 time: 0.803349 Nov 20 03:24:44.921286 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 48/93] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:44 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 1316 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:44.933480 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-7379e895-c624-46e0-9906-1fbba45bd480 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:44.934094 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-7379e895-c624-46e0-9906-1fbba45bd480 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:44.969620 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7379e895-c624-46e0-9906-1fbba45bd480 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:44.970705 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7379e895-c624-46e0-9906-1fbba45bd480 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:44.973636 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7379e895-c624-46e0-9906-1fbba45bd480 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:44.974507 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7379e895-c624-46e0-9906-1fbba45bd480 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:45.525143 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-246469c6-e7d2-4101-a7c2-905fc0744df1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:45.537395 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-246469c6-e7d2-4101-a7c2-905fc0744df1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:45.539563 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-246469c6-e7d2-4101-a7c2-905fc0744df1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:45.541629 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-246469c6-e7d2-4101-a7c2-905fc0744df1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1407 microversion: 2.20 time: 0.769377 Nov 20 03:24:45.553816 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 46/94] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:24:44 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1407 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:24:45.651418 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-7379e895-c624-46e0-9906-1fbba45bd480 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:45.663854 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-7379e895-c624-46e0-9906-1fbba45bd480 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1322 microversion: 2.1 time: 0.740755 Nov 20 03:24:45.664848 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 49/95] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:44 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1322 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:45.787157 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-bcce6422-6274-458d-9ee1-b37ec226b0b1 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:45.787759 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-bcce6422-6274-458d-9ee1-b37ec226b0b1 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:45.798711 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bcce6422-6274-458d-9ee1-b37ec226b0b1 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:45.799727 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bcce6422-6274-458d-9ee1-b37ec226b0b1 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:45.801175 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bcce6422-6274-458d-9ee1-b37ec226b0b1 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:45.801905 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bcce6422-6274-458d-9ee1-b37ec226b0b1 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:45.939621 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-1cfa9380-935b-465c-86f9-edd357be29ce tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:45.941063 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-1cfa9380-935b-465c-86f9-edd357be29ce tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:45.950226 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1cfa9380-935b-465c-86f9-edd357be29ce tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:45.952868 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1cfa9380-935b-465c-86f9-edd357be29ce tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:45.953972 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1cfa9380-935b-465c-86f9-edd357be29ce tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:45.954606 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1cfa9380-935b-465c-86f9-edd357be29ce tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:46.343023 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-bcce6422-6274-458d-9ee1-b37ec226b0b1 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:46.356972 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-bcce6422-6274-458d-9ee1-b37ec226b0b1 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1315 microversion: 2.1 time: 0.571084 Nov 20 03:24:46.370494 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 47/96] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:45 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1315 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:46.407160 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-1cfa9380-935b-465c-86f9-edd357be29ce tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:46.419816 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-1cfa9380-935b-465c-86f9-edd357be29ce tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 200 len: 1316 microversion: 2.1 time: 0.485621 Nov 20 03:24:46.422901 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 50/97] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:45 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 1316 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:24:46.565106 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-afa2e26a-7610-4e92-b66e-2c406231c2a8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:46.566730 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-afa2e26a-7610-4e92-b66e-2c406231c2a8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:46.595141 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-afa2e26a-7610-4e92-b66e-2c406231c2a8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:46.595910 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-afa2e26a-7610-4e92-b66e-2c406231c2a8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:46.598690 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-afa2e26a-7610-4e92-b66e-2c406231c2a8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:46.600486 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-afa2e26a-7610-4e92-b66e-2c406231c2a8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:46.625545 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-a9748e21-1d99-440e-8a58-47b7230f6436 req-a65b94bb-0544-45e4-a95b-ff59808db3b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "329637be-05e2-4b96-9709-c1b15f8f5f30", "tag": "ebf8d38e-80de-4df8-9ecf-25de53f3a222"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:24:46.627153 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:24:46.627153 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:24:46.645725 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-a9748e21-1d99-440e-8a58-47b7230f6436 req-a65b94bb-0544-45e4-a95b-ff59808db3b8 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:46.652743 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-a9748e21-1d99-440e-8a58-47b7230f6436 req-a65b94bb-0544-45e4-a95b-ff59808db3b8 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:46.691084 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-a9748e21-1d99-440e-8a58-47b7230f6436 req-a65b94bb-0544-45e4-a95b-ff59808db3b8 service nova] Creating event network-changed:ebf8d38e-80de-4df8-9ecf-25de53f3a222 for instance 329637be-05e2-4b96-9709-c1b15f8f5f30 on hv-cinder-81803 Nov 20 03:24:46.704181 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-a9748e21-1d99-440e-8a58-47b7230f6436 req-a65b94bb-0544-45e4-a95b-ff59808db3b8 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083127 Nov 20 03:24:46.711988 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 51/98] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:24:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:24:46.724950 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-00745d8f-c1b1-4c48-8da8-4e7d5213ab9c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:46.726375 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-00745d8f-c1b1-4c48-8da8-4e7d5213ab9c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:46.746068 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-00745d8f-c1b1-4c48-8da8-4e7d5213ab9c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:46.746816 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-00745d8f-c1b1-4c48-8da8-4e7d5213ab9c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:46.747330 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-00745d8f-c1b1-4c48-8da8-4e7d5213ab9c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:46.751949 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-00745d8f-c1b1-4c48-8da8-4e7d5213ab9c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:47.303691 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-afa2e26a-7610-4e92-b66e-2c406231c2a8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:47.312755 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-afa2e26a-7610-4e92-b66e-2c406231c2a8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:47.325597 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-afa2e26a-7610-4e92-b66e-2c406231c2a8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:47.327383 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-afa2e26a-7610-4e92-b66e-2c406231c2a8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1407 microversion: 2.20 time: 0.768038 Nov 20 03:24:47.328358 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 48/99] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:24:46 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1407 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:24:47.379515 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ffff38df-b5d9-491b-9c5d-f6421a203a2e tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:47.380153 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ffff38df-b5d9-491b-9c5d-f6421a203a2e tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:47.387768 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ffff38df-b5d9-491b-9c5d-f6421a203a2e tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:47.388462 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ffff38df-b5d9-491b-9c5d-f6421a203a2e tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:47.390157 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ffff38df-b5d9-491b-9c5d-f6421a203a2e tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:47.392437 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ffff38df-b5d9-491b-9c5d-f6421a203a2e tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:47.627924 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-00745d8f-c1b1-4c48-8da8-4e7d5213ab9c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:47.637471 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-00745d8f-c1b1-4c48-8da8-4e7d5213ab9c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1322 microversion: 2.1 time: 0.924107 Nov 20 03:24:47.638250 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 52/100] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:46 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1322 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:47.645082 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-0c049a15-96fe-4a99-b97e-c7629ee2db83 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:47.645833 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-0c049a15-96fe-4a99-b97e-c7629ee2db83 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:47.653117 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0c049a15-96fe-4a99-b97e-c7629ee2db83 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:47.654242 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0c049a15-96fe-4a99-b97e-c7629ee2db83 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:47.657562 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0c049a15-96fe-4a99-b97e-c7629ee2db83 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:47.659059 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0c049a15-96fe-4a99-b97e-c7629ee2db83 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:47.980887 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-ffff38df-b5d9-491b-9c5d-f6421a203a2e tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:47.993633 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ffff38df-b5d9-491b-9c5d-f6421a203a2e tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1315 microversion: 2.1 time: 0.618257 Nov 20 03:24:47.995600 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 49/101] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:47 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1315 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:24:48.132538 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-0c049a15-96fe-4a99-b97e-c7629ee2db83 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:48.144521 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-0c049a15-96fe-4a99-b97e-c7629ee2db83 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 200 len: 1316 microversion: 2.1 time: 0.504048 Nov 20 03:24:48.146237 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 53/102] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:47 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 1316 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:48.345710 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-0602f941-2402-4a5d-848d-7638bce1d9bb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:48.346259 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-0602f941-2402-4a5d-848d-7638bce1d9bb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:48.357254 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0602f941-2402-4a5d-848d-7638bce1d9bb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:48.358255 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0602f941-2402-4a5d-848d-7638bce1d9bb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:48.359167 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0602f941-2402-4a5d-848d-7638bce1d9bb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:48.359600 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0602f941-2402-4a5d-848d-7638bce1d9bb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:48.655682 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-48c02852-a131-45d1-a070-db8ee490b951 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:48.657535 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-48c02852-a131-45d1-a070-db8ee490b951 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:48.671554 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-48c02852-a131-45d1-a070-db8ee490b951 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:48.672705 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-48c02852-a131-45d1-a070-db8ee490b951 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:48.674262 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-48c02852-a131-45d1-a070-db8ee490b951 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:48.675959 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-48c02852-a131-45d1-a070-db8ee490b951 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:48.803323 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-0602f941-2402-4a5d-848d-7638bce1d9bb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:48.818641 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-0602f941-2402-4a5d-848d-7638bce1d9bb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:48.821492 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-0602f941-2402-4a5d-848d-7638bce1d9bb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:48.826141 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-0602f941-2402-4a5d-848d-7638bce1d9bb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1407 microversion: 2.20 time: 0.482794 Nov 20 03:24:48.827096 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 50/103] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:24:48 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1407 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:24:49.017435 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-deaf9a7f-7554-4c46-8ffc-4ab40b3ff88a req-da80c7a0-2d5d-49f2-b6ce-786dae34a88c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459573a2-39ec-47c3-8815-297d17954f29", "name": "network-vif-plugged", "status": "completed", "tag": "aabfdd18-ae62-4c81-b28d-067cee7510cd"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:24:49.019984 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:24:49.019984 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:24:49.029897 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-deaf9a7f-7554-4c46-8ffc-4ab40b3ff88a req-da80c7a0-2d5d-49f2-b6ce-786dae34a88c service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:49.030332 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-deaf9a7f-7554-4c46-8ffc-4ab40b3ff88a req-da80c7a0-2d5d-49f2-b6ce-786dae34a88c service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:49.050485 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-deaf9a7f-7554-4c46-8ffc-4ab40b3ff88a req-da80c7a0-2d5d-49f2-b6ce-786dae34a88c service nova] Creating event network-vif-plugged:aabfdd18-ae62-4c81-b28d-067cee7510cd for instance 459573a2-39ec-47c3-8815-297d17954f29 on hv-cinder-81803 Nov 20 03:24:49.051060 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-deaf9a7f-7554-4c46-8ffc-4ab40b3ff88a req-da80c7a0-2d5d-49f2-b6ce-786dae34a88c service nova] Acquired lock "compute-rpcapi-router" {{(pid=116113) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 20 03:24:49.052713 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-80910ef4-c33c-4d60-8086-e626c1c0f591 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:49.053302 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-80910ef4-c33c-4d60-8086-e626c1c0f591 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:49.054453 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-80910ef4-c33c-4d60-8086-e626c1c0f591 None None] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:49.054875 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-80910ef4-c33c-4d60-8086-e626c1c0f591 None None] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:49.069338 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.compute.rpcapi [None req-80910ef4-c33c-4d60-8086-e626c1c0f591 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 20 03:24:49.069632 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-48c02852-a131-45d1-a070-db8ee490b951 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:49.077045 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-48c02852-a131-45d1-a070-db8ee490b951 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1322 microversion: 2.1 time: 0.426441 Nov 20 03:24:49.080799 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 54/104] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:48 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1322 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:49.086968 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-2b282e89-e19e-43a3-8972-ecfbd6e913f8 req-bd6d3eaa-cf51-4c0b-96a6-7bbff5d97c9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f68eb618-c745-43db-a873-7c0700c0f11c", "tag": "7a19e0fe-867b-45fc-9ef7-f883f1a8dbd9"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:24:49.089761 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:24:49.089761 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:24:49.093806 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-80910ef4-c33c-4d60-8086-e626c1c0f591 None None] Releasing lock "compute-rpcapi-router" {{(pid=116113) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 20 03:24:49.102154 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-2b282e89-e19e-43a3-8972-ecfbd6e913f8 req-bd6d3eaa-cf51-4c0b-96a6-7bbff5d97c9e service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:49.102831 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-2b282e89-e19e-43a3-8972-ecfbd6e913f8 req-bd6d3eaa-cf51-4c0b-96a6-7bbff5d97c9e service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:49.121248 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-2b282e89-e19e-43a3-8972-ecfbd6e913f8 req-bd6d3eaa-cf51-4c0b-96a6-7bbff5d97c9e service nova] Creating event network-changed:7a19e0fe-867b-45fc-9ef7-f883f1a8dbd9 for instance f68eb618-c745-43db-a873-7c0700c0f11c on hv-cinder-81803 Nov 20 03:24:49.129708 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-80910ef4-c33c-4d60-8086-e626c1c0f591 None None] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.299284 Nov 20 03:24:49.130659 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 51/105] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:24:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:24:49.141550 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-2b282e89-e19e-43a3-8972-ecfbd6e913f8 req-bd6d3eaa-cf51-4c0b-96a6-7bbff5d97c9e service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058266 Nov 20 03:24:49.142634 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 55/106] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:24:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:24:49.143912 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-6e5c2f1a-7991-4349-ae29-89d56bd19652 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:49.144750 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-6e5c2f1a-7991-4349-ae29-89d56bd19652 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:49.155353 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6e5c2f1a-7991-4349-ae29-89d56bd19652 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:49.155918 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6e5c2f1a-7991-4349-ae29-89d56bd19652 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:49.169327 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6e5c2f1a-7991-4349-ae29-89d56bd19652 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:49.170461 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6e5c2f1a-7991-4349-ae29-89d56bd19652 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:49.173718 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-4cfb53b3-5679-46b9-b4ab-ef4be9456fca tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:49.174443 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-4cfb53b3-5679-46b9-b4ab-ef4be9456fca tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:49.191211 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4cfb53b3-5679-46b9-b4ab-ef4be9456fca tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:49.191672 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4cfb53b3-5679-46b9-b4ab-ef4be9456fca tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:49.194878 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4cfb53b3-5679-46b9-b4ab-ef4be9456fca tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:49.197067 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4cfb53b3-5679-46b9-b4ab-ef4be9456fca tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:49.739866 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-6e5c2f1a-7991-4349-ae29-89d56bd19652 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:49.748468 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-6e5c2f1a-7991-4349-ae29-89d56bd19652 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1315 microversion: 2.1 time: 0.616039 Nov 20 03:24:49.749535 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 52/107] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:49 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1315 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:49.811378 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-4cfb53b3-5679-46b9-b4ab-ef4be9456fca tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:49.826795 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-4cfb53b3-5679-46b9-b4ab-ef4be9456fca tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 200 len: 1316 microversion: 2.1 time: 0.659613 Nov 20 03:24:49.836727 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 56/108] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:49 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 1316 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:49.844950 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-72e3e55b-4db8-41bc-9ac2-8755fd92bb65 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:49.845545 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-72e3e55b-4db8-41bc-9ac2-8755fd92bb65 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:49.858734 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-72e3e55b-4db8-41bc-9ac2-8755fd92bb65 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:49.859389 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-72e3e55b-4db8-41bc-9ac2-8755fd92bb65 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:49.860398 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-72e3e55b-4db8-41bc-9ac2-8755fd92bb65 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:49.861136 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-72e3e55b-4db8-41bc-9ac2-8755fd92bb65 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:50.100553 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-9b5ff00f-8afb-4f32-b24c-43f213c6df94 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:50.101456 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-9b5ff00f-8afb-4f32-b24c-43f213c6df94 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:50.110916 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9b5ff00f-8afb-4f32-b24c-43f213c6df94 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:50.114435 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9b5ff00f-8afb-4f32-b24c-43f213c6df94 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:50.116788 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9b5ff00f-8afb-4f32-b24c-43f213c6df94 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:50.117456 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9b5ff00f-8afb-4f32-b24c-43f213c6df94 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:50.516267 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-72e3e55b-4db8-41bc-9ac2-8755fd92bb65 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:50.530935 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-72e3e55b-4db8-41bc-9ac2-8755fd92bb65 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:50.532784 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-72e3e55b-4db8-41bc-9ac2-8755fd92bb65 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:50.534139 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-72e3e55b-4db8-41bc-9ac2-8755fd92bb65 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1407 microversion: 2.20 time: 0.693424 Nov 20 03:24:50.536462 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 53/109] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:24:49 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1407 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:24:50.600288 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-9b5ff00f-8afb-4f32-b24c-43f213c6df94 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:50.608063 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-9b5ff00f-8afb-4f32-b24c-43f213c6df94 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1322 microversion: 2.1 time: 0.511496 Nov 20 03:24:50.617084 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 57/110] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:50 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1322 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:50.766913 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-a6f9bace-4948-4a69-9cd6-5f948b0a647e tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:50.768595 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-a6f9bace-4948-4a69-9cd6-5f948b0a647e tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:50.779602 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a6f9bace-4948-4a69-9cd6-5f948b0a647e tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:50.780092 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a6f9bace-4948-4a69-9cd6-5f948b0a647e tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:50.780879 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a6f9bace-4948-4a69-9cd6-5f948b0a647e tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:50.781476 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a6f9bace-4948-4a69-9cd6-5f948b0a647e tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:50.847494 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-a0d70ad8-1957-4316-8568-44dc221aefb9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:50.848144 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-a0d70ad8-1957-4316-8568-44dc221aefb9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:50.857256 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a0d70ad8-1957-4316-8568-44dc221aefb9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:50.858369 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a0d70ad8-1957-4316-8568-44dc221aefb9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:50.860000 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a0d70ad8-1957-4316-8568-44dc221aefb9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:50.860696 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a0d70ad8-1957-4316-8568-44dc221aefb9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:51.141455 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-a0d70ad8-1957-4316-8568-44dc221aefb9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:51.156731 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-a0d70ad8-1957-4316-8568-44dc221aefb9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 200 len: 1316 microversion: 2.1 time: 0.316175 Nov 20 03:24:51.166622 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 58/111] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:50 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 1316 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:24:51.166622 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-4908e977-4207-48f7-9799-0648f59044af req-4da3926a-6ab5-45d7-9fb6-899cc9f0dff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b039039-82f2-411a-8b2f-39e31df51f77", "name": "network-vif-plugged", "status": "completed", "tag": "6cabe651-4a25-4e86-bfd6-a1e07df36346"}, {"server_uuid": "1520eab8-d6b9-48aa-8333-5c7758310e82", "name": "network-vif-plugged", "status": "completed", "tag": "04b72906-e641-41e4-a5a9-636c7cd117c9"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:24:51.169930 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:24:51.169930 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:24:51.184518 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-4908e977-4207-48f7-9799-0648f59044af req-4da3926a-6ab5-45d7-9fb6-899cc9f0dff2 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:51.192086 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-4908e977-4207-48f7-9799-0648f59044af req-4da3926a-6ab5-45d7-9fb6-899cc9f0dff2 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:51.214151 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-4908e977-4207-48f7-9799-0648f59044af req-4da3926a-6ab5-45d7-9fb6-899cc9f0dff2 service nova] Creating event network-vif-plugged:6cabe651-4a25-4e86-bfd6-a1e07df36346 for instance 3b039039-82f2-411a-8b2f-39e31df51f77 on hv-cinder-81803 Nov 20 03:24:51.214654 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-4908e977-4207-48f7-9799-0648f59044af req-4da3926a-6ab5-45d7-9fb6-899cc9f0dff2 service nova] Creating event network-vif-plugged:04b72906-e641-41e4-a5a9-636c7cd117c9 for instance 1520eab8-d6b9-48aa-8333-5c7758310e82 on hv-cinder-81803 Nov 20 03:24:51.230801 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a6f9bace-4948-4a69-9cd6-5f948b0a647e tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:51.237543 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-4908e977-4207-48f7-9799-0648f59044af req-4da3926a-6ab5-45d7-9fb6-899cc9f0dff2 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.078641 Nov 20 03:24:51.238453 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 59/112] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:24:51 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:24:51.248991 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-a6f9bace-4948-4a69-9cd6-5f948b0a647e tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1315 microversion: 2.1 time: 0.484870 Nov 20 03:24:51.249518 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 54/113] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:50 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1315 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:51.556293 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-15d10b9a-7bab-41b2-8543-cb859effecd1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:51.557131 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-15d10b9a-7bab-41b2-8543-cb859effecd1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:51.564182 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-15d10b9a-7bab-41b2-8543-cb859effecd1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:51.564687 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-15d10b9a-7bab-41b2-8543-cb859effecd1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:51.565639 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-15d10b9a-7bab-41b2-8543-cb859effecd1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:51.566042 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-15d10b9a-7bab-41b2-8543-cb859effecd1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:51.627954 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-c6b4faad-50b1-45b0-b212-680e54c2d422 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:51.629384 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-c6b4faad-50b1-45b0-b212-680e54c2d422 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:51.640009 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c6b4faad-50b1-45b0-b212-680e54c2d422 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:51.640616 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c6b4faad-50b1-45b0-b212-680e54c2d422 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:51.641604 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c6b4faad-50b1-45b0-b212-680e54c2d422 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:51.642292 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c6b4faad-50b1-45b0-b212-680e54c2d422 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:51.902071 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-15d10b9a-7bab-41b2-8543-cb859effecd1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:51.917371 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-15d10b9a-7bab-41b2-8543-cb859effecd1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:51.924197 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-15d10b9a-7bab-41b2-8543-cb859effecd1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:51.927562 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-15d10b9a-7bab-41b2-8543-cb859effecd1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1407 microversion: 2.20 time: 0.376365 Nov 20 03:24:51.930978 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 60/114] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:24:51 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1407 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:24:52.014489 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-c6b4faad-50b1-45b0-b212-680e54c2d422 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:52.029138 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-c6b4faad-50b1-45b0-b212-680e54c2d422 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1322 microversion: 2.1 time: 0.407408 Nov 20 03:24:52.030045 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 55/115] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:51 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:24:52.177062 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-1125677a-9764-4465-8ecd-a9c9e751f651 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:52.177961 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-1125677a-9764-4465-8ecd-a9c9e751f651 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:52.185834 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1125677a-9764-4465-8ecd-a9c9e751f651 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:52.186615 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1125677a-9764-4465-8ecd-a9c9e751f651 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:52.187554 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1125677a-9764-4465-8ecd-a9c9e751f651 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:52.188213 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1125677a-9764-4465-8ecd-a9c9e751f651 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:52.266080 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-bcb3c8e4-1349-4d36-ab31-9b5012062df5 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:52.267387 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-bcb3c8e4-1349-4d36-ab31-9b5012062df5 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:52.284009 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bcb3c8e4-1349-4d36-ab31-9b5012062df5 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:52.285925 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bcb3c8e4-1349-4d36-ab31-9b5012062df5 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:52.289888 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bcb3c8e4-1349-4d36-ab31-9b5012062df5 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:52.290385 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bcb3c8e4-1349-4d36-ab31-9b5012062df5 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:52.426291 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-1125677a-9764-4465-8ecd-a9c9e751f651 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:52.436008 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-1125677a-9764-4465-8ecd-a9c9e751f651 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 200 len: 1316 microversion: 2.1 time: 0.264517 Nov 20 03:24:52.436930 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 61/116] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:52 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 1316 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:52.558241 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-bcb3c8e4-1349-4d36-ab31-9b5012062df5 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:52.566972 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-bcb3c8e4-1349-4d36-ab31-9b5012062df5 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1315 microversion: 2.1 time: 0.304507 Nov 20 03:24:52.577857 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 56/117] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:52 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:24:52.948651 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-d367657a-ebc9-40c6-84be-e64b8402c9b8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:52.950104 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-d367657a-ebc9-40c6-84be-e64b8402c9b8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:52.956149 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d367657a-ebc9-40c6-84be-e64b8402c9b8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:52.956860 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d367657a-ebc9-40c6-84be-e64b8402c9b8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:52.957903 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d367657a-ebc9-40c6-84be-e64b8402c9b8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:52.958521 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d367657a-ebc9-40c6-84be-e64b8402c9b8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:53.049407 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-3f9a6c62-67d9-4fba-a258-e158b8f3a3f0 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:53.050173 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-3f9a6c62-67d9-4fba-a258-e158b8f3a3f0 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:53.062130 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3f9a6c62-67d9-4fba-a258-e158b8f3a3f0 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:53.062592 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3f9a6c62-67d9-4fba-a258-e158b8f3a3f0 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:53.065511 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3f9a6c62-67d9-4fba-a258-e158b8f3a3f0 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:53.065955 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3f9a6c62-67d9-4fba-a258-e158b8f3a3f0 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:53.176052 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-d367657a-ebc9-40c6-84be-e64b8402c9b8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:53.185712 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-d367657a-ebc9-40c6-84be-e64b8402c9b8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:53.188244 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-d367657a-ebc9-40c6-84be-e64b8402c9b8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:53.190943 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-d367657a-ebc9-40c6-84be-e64b8402c9b8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1407 microversion: 2.20 time: 0.246428 Nov 20 03:24:53.192371 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 62/118] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:24:52 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:24:53.270048 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-3f9a6c62-67d9-4fba-a258-e158b8f3a3f0 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:53.280876 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-3f9a6c62-67d9-4fba-a258-e158b8f3a3f0 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1322 microversion: 2.1 time: 0.238045 Nov 20 03:24:53.282395 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 57/119] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:53 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:24:53.454988 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-473d7c8e-7519-4dd0-a15e-130b78f01027 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:53.456933 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-473d7c8e-7519-4dd0-a15e-130b78f01027 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:53.469028 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-473d7c8e-7519-4dd0-a15e-130b78f01027 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:53.470590 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-473d7c8e-7519-4dd0-a15e-130b78f01027 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:53.472888 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-473d7c8e-7519-4dd0-a15e-130b78f01027 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:53.473588 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-473d7c8e-7519-4dd0-a15e-130b78f01027 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:53.586445 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-98e8c60d-787e-454a-b39c-205333efdcfe tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:53.587413 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-98e8c60d-787e-454a-b39c-205333efdcfe tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:53.595507 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-98e8c60d-787e-454a-b39c-205333efdcfe tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:53.596047 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-98e8c60d-787e-454a-b39c-205333efdcfe tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:53.597373 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-98e8c60d-787e-454a-b39c-205333efdcfe tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:53.598069 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-98e8c60d-787e-454a-b39c-205333efdcfe tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:53.732001 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-473d7c8e-7519-4dd0-a15e-130b78f01027 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:53.740657 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-473d7c8e-7519-4dd0-a15e-130b78f01027 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 200 len: 1316 microversion: 2.1 time: 0.291028 Nov 20 03:24:53.741630 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 63/120] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:53 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 1316 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:53.811297 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-98e8c60d-787e-454a-b39c-205333efdcfe tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:53.819620 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-98e8c60d-787e-454a-b39c-205333efdcfe tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1503 microversion: 2.1 time: 0.237822 Nov 20 03:24:53.820532 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 58/121] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:53 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1503 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:54.211688 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-f3fd36f6-d603-44f5-9897-eeb6fa2ec081 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:54.212441 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-f3fd36f6-d603-44f5-9897-eeb6fa2ec081 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:54.223381 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f3fd36f6-d603-44f5-9897-eeb6fa2ec081 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:54.223856 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f3fd36f6-d603-44f5-9897-eeb6fa2ec081 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:54.224901 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f3fd36f6-d603-44f5-9897-eeb6fa2ec081 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:54.225337 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f3fd36f6-d603-44f5-9897-eeb6fa2ec081 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:54.298056 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-227fe8bb-7aac-41a0-9b95-50ccae215360 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:54.299414 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-227fe8bb-7aac-41a0-9b95-50ccae215360 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:54.306607 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-227fe8bb-7aac-41a0-9b95-50ccae215360 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:54.307762 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-227fe8bb-7aac-41a0-9b95-50ccae215360 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:54.308812 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-227fe8bb-7aac-41a0-9b95-50ccae215360 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:54.309421 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-227fe8bb-7aac-41a0-9b95-50ccae215360 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:54.425371 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-f3fd36f6-d603-44f5-9897-eeb6fa2ec081 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:54.437843 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-f3fd36f6-d603-44f5-9897-eeb6fa2ec081 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:54.439830 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-f3fd36f6-d603-44f5-9897-eeb6fa2ec081 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:54.441027 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-f3fd36f6-d603-44f5-9897-eeb6fa2ec081 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1407 microversion: 2.20 time: 0.233076 Nov 20 03:24:54.442308 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 64/122] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:24:54 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:24:54.511585 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-227fe8bb-7aac-41a0-9b95-50ccae215360 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:54.528550 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-227fe8bb-7aac-41a0-9b95-50ccae215360 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1322 microversion: 2.1 time: 0.234869 Nov 20 03:24:54.539941 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 59/123] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:54 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:24:54.758312 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-81bd5dd7-1e1a-4d43-ad7d-43ba93551ed2 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:54.765241 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-81bd5dd7-1e1a-4d43-ad7d-43ba93551ed2 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:54.765241 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-81bd5dd7-1e1a-4d43-ad7d-43ba93551ed2 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:54.765663 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-81bd5dd7-1e1a-4d43-ad7d-43ba93551ed2 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:54.766605 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-81bd5dd7-1e1a-4d43-ad7d-43ba93551ed2 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:54.767197 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-81bd5dd7-1e1a-4d43-ad7d-43ba93551ed2 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:54.921618 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-81bd5dd7-1e1a-4d43-ad7d-43ba93551ed2 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:54.929059 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-81bd5dd7-1e1a-4d43-ad7d-43ba93551ed2 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 200 len: 1316 microversion: 2.1 time: 0.174534 Nov 20 03:24:54.929629 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 65/124] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:54 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 1316 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:55.460560 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-786fec88-56c1-4d9b-8676-a4f8e7b4ba4f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:55.461240 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-786fec88-56c1-4d9b-8676-a4f8e7b4ba4f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:55.467165 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-786fec88-56c1-4d9b-8676-a4f8e7b4ba4f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:55.467614 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-786fec88-56c1-4d9b-8676-a4f8e7b4ba4f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:55.468494 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-786fec88-56c1-4d9b-8676-a4f8e7b4ba4f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:55.468896 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-786fec88-56c1-4d9b-8676-a4f8e7b4ba4f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:55.547254 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-229ba14e-885c-4e2a-a959-b346c9cf3758 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:55.548748 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-229ba14e-885c-4e2a-a959-b346c9cf3758 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:55.557326 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-229ba14e-885c-4e2a-a959-b346c9cf3758 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:55.558184 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-229ba14e-885c-4e2a-a959-b346c9cf3758 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:55.560686 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-229ba14e-885c-4e2a-a959-b346c9cf3758 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:55.561289 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-229ba14e-885c-4e2a-a959-b346c9cf3758 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:55.656272 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-786fec88-56c1-4d9b-8676-a4f8e7b4ba4f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:55.673597 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-786fec88-56c1-4d9b-8676-a4f8e7b4ba4f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:55.683720 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-786fec88-56c1-4d9b-8676-a4f8e7b4ba4f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:55.684904 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-786fec88-56c1-4d9b-8676-a4f8e7b4ba4f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1407 microversion: 2.20 time: 0.228069 Nov 20 03:24:55.686256 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 60/125] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:24:55 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:24:55.745560 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-229ba14e-885c-4e2a-a959-b346c9cf3758 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:55.763953 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-229ba14e-885c-4e2a-a959-b346c9cf3758 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1322 microversion: 2.1 time: 0.221110 Nov 20 03:24:55.767871 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 66/126] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:55 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:24:55.946530 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-5f33e953-1370-4cc6-a6e7-ebd9bea8a50b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:55.947289 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-5f33e953-1370-4cc6-a6e7-ebd9bea8a50b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:55.953470 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5f33e953-1370-4cc6-a6e7-ebd9bea8a50b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:55.953990 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5f33e953-1370-4cc6-a6e7-ebd9bea8a50b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:55.954836 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5f33e953-1370-4cc6-a6e7-ebd9bea8a50b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:55.955338 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5f33e953-1370-4cc6-a6e7-ebd9bea8a50b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:56.089659 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-5f33e953-1370-4cc6-a6e7-ebd9bea8a50b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:56.097470 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-5f33e953-1370-4cc6-a6e7-ebd9bea8a50b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 200 len: 1316 microversion: 2.1 time: 0.154770 Nov 20 03:24:56.098040 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 61/127] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:55 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:56.703018 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-2853a659-125e-48b6-9081-a21017783dd1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:56.703626 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-2853a659-125e-48b6-9081-a21017783dd1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:56.709462 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2853a659-125e-48b6-9081-a21017783dd1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:56.709894 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2853a659-125e-48b6-9081-a21017783dd1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:56.710662 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2853a659-125e-48b6-9081-a21017783dd1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:56.711120 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2853a659-125e-48b6-9081-a21017783dd1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:56.780823 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-5f9d2c90-c93a-4cef-a53b-c1742ed6b6d7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:56.781737 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-5f9d2c90-c93a-4cef-a53b-c1742ed6b6d7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:56.787916 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5f9d2c90-c93a-4cef-a53b-c1742ed6b6d7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:56.788365 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5f9d2c90-c93a-4cef-a53b-c1742ed6b6d7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:56.789147 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5f9d2c90-c93a-4cef-a53b-c1742ed6b6d7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:56.789581 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5f9d2c90-c93a-4cef-a53b-c1742ed6b6d7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:56.875765 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-2853a659-125e-48b6-9081-a21017783dd1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:56.884268 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-2853a659-125e-48b6-9081-a21017783dd1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:56.885782 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-2853a659-125e-48b6-9081-a21017783dd1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:56.887468 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-2853a659-125e-48b6-9081-a21017783dd1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1407 microversion: 2.20 time: 0.188524 Nov 20 03:24:56.892050 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 67/128] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:24:56 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:24:56.953737 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-5f9d2c90-c93a-4cef-a53b-c1742ed6b6d7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:56.961609 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-5f9d2c90-c93a-4cef-a53b-c1742ed6b6d7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1322 microversion: 2.1 time: 0.184390 Nov 20 03:24:56.962171 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 62/129] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:56 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:24:57.114853 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-d7699360-730a-40aa-a62d-befafd8428d8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:57.115467 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-d7699360-730a-40aa-a62d-befafd8428d8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:57.121331 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d7699360-730a-40aa-a62d-befafd8428d8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:57.121786 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d7699360-730a-40aa-a62d-befafd8428d8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:57.123159 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d7699360-730a-40aa-a62d-befafd8428d8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:57.123774 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d7699360-730a-40aa-a62d-befafd8428d8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:57.269505 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-d7699360-730a-40aa-a62d-befafd8428d8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:57.277302 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-d7699360-730a-40aa-a62d-befafd8428d8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 200 len: 1507 microversion: 2.1 time: 0.165936 Nov 20 03:24:57.277897 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 68/130] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:57 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:57.392104 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-37dfd3a5-68ab-4e80-a2c2-d11c0a2b4012 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4834c88b-77bc-4e4c-bc50-a4aa654f2d64"}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:24:57.393432 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-37dfd3a5-68ab-4e80-a2c2-d11c0a2b4012 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:57.399499 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-37dfd3a5-68ab-4e80-a2c2-d11c0a2b4012 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:57.399986 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-37dfd3a5-68ab-4e80-a2c2-d11c0a2b4012 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:57.400804 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-37dfd3a5-68ab-4e80-a2c2-d11c0a2b4012 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:57.401238 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-37dfd3a5-68ab-4e80-a2c2-d11c0a2b4012 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:57.908911 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-919f5c96-9a73-412a-87f9-26e057faf7b2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:57.910035 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-919f5c96-9a73-412a-87f9-26e057faf7b2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:57.917548 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-919f5c96-9a73-412a-87f9-26e057faf7b2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:57.918074 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-919f5c96-9a73-412a-87f9-26e057faf7b2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:57.919098 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-919f5c96-9a73-412a-87f9-26e057faf7b2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:57.919708 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-919f5c96-9a73-412a-87f9-26e057faf7b2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:58.086202 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-919f5c96-9a73-412a-87f9-26e057faf7b2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:58.094529 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-919f5c96-9a73-412a-87f9-26e057faf7b2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:58.096149 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-919f5c96-9a73-412a-87f9-26e057faf7b2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:58.097280 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-919f5c96-9a73-412a-87f9-26e057faf7b2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1407 microversion: 2.20 time: 0.193120 Nov 20 03:24:58.097832 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 69/131] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:24:57 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:24:58.102191 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-e689a680-a27b-43b7-baae-2f8364db7235 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:58.102785 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-e689a680-a27b-43b7-baae-2f8364db7235 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:58.109401 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e689a680-a27b-43b7-baae-2f8364db7235 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:58.109858 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e689a680-a27b-43b7-baae-2f8364db7235 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:58.110634 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e689a680-a27b-43b7-baae-2f8364db7235 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:58.111067 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e689a680-a27b-43b7-baae-2f8364db7235 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:58.244718 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-e689a680-a27b-43b7-baae-2f8364db7235 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:58.253645 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-e689a680-a27b-43b7-baae-2f8364db7235 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1322 microversion: 2.1 time: 0.154875 Nov 20 03:24:58.254263 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 70/132] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:58 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:24:59.115433 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-b6c0646b-ae52-4240-ad12-1b199be18925 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:59.116092 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-b6c0646b-ae52-4240-ad12-1b199be18925 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:59.121822 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b6c0646b-ae52-4240-ad12-1b199be18925 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:59.122268 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b6c0646b-ae52-4240-ad12-1b199be18925 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:59.123535 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b6c0646b-ae52-4240-ad12-1b199be18925 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:59.123992 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b6c0646b-ae52-4240-ad12-1b199be18925 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:59.253242 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-b6c0646b-ae52-4240-ad12-1b199be18925 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:59.260866 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-b6c0646b-ae52-4240-ad12-1b199be18925 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:59.262371 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-b6c0646b-ae52-4240-ad12-1b199be18925 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:59.264092 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-b6c0646b-ae52-4240-ad12-1b199be18925 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1407 microversion: 2.20 time: 0.151845 Nov 20 03:24:59.264650 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 71/133] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:24:59 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:24:59.269679 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-c04c100b-9c56-4aa4-9dd7-229e1ee141bd tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:24:59.270280 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-c04c100b-9c56-4aa4-9dd7-229e1ee141bd tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:24:59.275870 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c04c100b-9c56-4aa4-9dd7-229e1ee141bd tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:59.276317 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c04c100b-9c56-4aa4-9dd7-229e1ee141bd tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:59.277089 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c04c100b-9c56-4aa4-9dd7-229e1ee141bd tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:59.277524 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c04c100b-9c56-4aa4-9dd7-229e1ee141bd tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:59.403681 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-c04c100b-9c56-4aa4-9dd7-229e1ee141bd tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:24:59.410756 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-c04c100b-9c56-4aa4-9dd7-229e1ee141bd tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1322 microversion: 2.1 time: 0.144372 Nov 20 03:24:59.411297 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 72/134] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:24:59 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:24:59.632992 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-ac9baac1-b027-4490-8cad-2cfb8660ace1 req-933aa9fa-6d68-4a99-953e-72d140d11303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "329637be-05e2-4b96-9709-c1b15f8f5f30", "name": "network-vif-plugged", "status": "completed", "tag": "ebf8d38e-80de-4df8-9ecf-25de53f3a222"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:24:59.634772 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:24:59.634772 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:24:59.641597 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-ac9baac1-b027-4490-8cad-2cfb8660ace1 req-933aa9fa-6d68-4a99-953e-72d140d11303 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:24:59.642041 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-ac9baac1-b027-4490-8cad-2cfb8660ace1 req-933aa9fa-6d68-4a99-953e-72d140d11303 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:24:59.653194 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-ac9baac1-b027-4490-8cad-2cfb8660ace1 req-933aa9fa-6d68-4a99-953e-72d140d11303 service nova] Creating event network-vif-plugged:ebf8d38e-80de-4df8-9ecf-25de53f3a222 for instance 329637be-05e2-4b96-9709-c1b15f8f5f30 on hv-cinder-81803 Nov 20 03:24:59.658864 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-ac9baac1-b027-4490-8cad-2cfb8660ace1 req-933aa9fa-6d68-4a99-953e-72d140d11303 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029347 Nov 20 03:24:59.659705 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 73/135] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:24:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:25:00.283048 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-70828fd5-10de-4a89-9361-a00ceaa1a2a6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:00.283760 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-70828fd5-10de-4a89-9361-a00ceaa1a2a6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:00.289818 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-70828fd5-10de-4a89-9361-a00ceaa1a2a6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:00.290255 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-70828fd5-10de-4a89-9361-a00ceaa1a2a6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:00.291013 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-70828fd5-10de-4a89-9361-a00ceaa1a2a6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:00.291439 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-70828fd5-10de-4a89-9361-a00ceaa1a2a6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:00.427622 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-70828fd5-10de-4a89-9361-a00ceaa1a2a6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:00.435292 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-70828fd5-10de-4a89-9361-a00ceaa1a2a6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:00.437320 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-70828fd5-10de-4a89-9361-a00ceaa1a2a6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:00.438403 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-70828fd5-10de-4a89-9361-a00ceaa1a2a6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1407 microversion: 2.20 time: 0.160053 Nov 20 03:25:00.438946 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 74/136] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:25:00 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:25:00.443028 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-88017067-85c9-478f-81a2-d3fc2d433857 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:00.443626 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-88017067-85c9-478f-81a2-d3fc2d433857 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:00.448963 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-88017067-85c9-478f-81a2-d3fc2d433857 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:00.449407 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-88017067-85c9-478f-81a2-d3fc2d433857 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:00.450180 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-88017067-85c9-478f-81a2-d3fc2d433857 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:00.450621 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-88017067-85c9-478f-81a2-d3fc2d433857 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:00.590087 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-88017067-85c9-478f-81a2-d3fc2d433857 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:00.598268 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-88017067-85c9-478f-81a2-d3fc2d433857 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1322 microversion: 2.1 time: 0.158340 Nov 20 03:25:00.609154 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 75/137] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:00 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:00.703557 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-37dfd3a5-68ab-4e80-a2c2-d11c0a2b4012 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "POST /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.316765 Nov 20 03:25:00.705590 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 63/138] 10.222.0.37 () {60 vars in 1322 bytes} [Sat Nov 20 03:24:57 2021] POST /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29/os-volume_attachments => generated 194 bytes in 3320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:25:01.456604 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-3ca1a140-382f-4858-bb00-8121b4c1af27 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:01.457313 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-3ca1a140-382f-4858-bb00-8121b4c1af27 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:01.463439 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3ca1a140-382f-4858-bb00-8121b4c1af27 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:01.464005 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3ca1a140-382f-4858-bb00-8121b4c1af27 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:01.464848 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3ca1a140-382f-4858-bb00-8121b4c1af27 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:01.465444 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3ca1a140-382f-4858-bb00-8121b4c1af27 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:01.606860 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-3ca1a140-382f-4858-bb00-8121b4c1af27 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:01.614831 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-3ca1a140-382f-4858-bb00-8121b4c1af27 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:01.616337 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ee490c60-75e7-4f98-a831-b2e7dafbdb8d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:01.616476 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-3ca1a140-382f-4858-bb00-8121b4c1af27 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:01.617034 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ee490c60-75e7-4f98-a831-b2e7dafbdb8d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:01.617442 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-3ca1a140-382f-4858-bb00-8121b4c1af27 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1407 microversion: 2.20 time: 0.164809 Nov 20 03:25:01.618191 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 76/139] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:25:01 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:25:01.623657 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ee490c60-75e7-4f98-a831-b2e7dafbdb8d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:01.624135 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ee490c60-75e7-4f98-a831-b2e7dafbdb8d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:01.624923 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ee490c60-75e7-4f98-a831-b2e7dafbdb8d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:01.625356 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ee490c60-75e7-4f98-a831-b2e7dafbdb8d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:01.697187 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-228c341f-8dd5-423b-a043-92fc27f7e469 req-fcf10122-f37f-4794-996c-cc444994288a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f68eb618-c745-43db-a873-7c0700c0f11c", "name": "network-vif-plugged", "status": "completed", "tag": "7a19e0fe-867b-45fc-9ef7-f883f1a8dbd9"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:01.698715 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:25:01.698715 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:25:01.706068 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-228c341f-8dd5-423b-a043-92fc27f7e469 req-fcf10122-f37f-4794-996c-cc444994288a service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:01.706503 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-228c341f-8dd5-423b-a043-92fc27f7e469 req-fcf10122-f37f-4794-996c-cc444994288a service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:01.718551 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-228c341f-8dd5-423b-a043-92fc27f7e469 req-fcf10122-f37f-4794-996c-cc444994288a service nova] Creating event network-vif-plugged:7a19e0fe-867b-45fc-9ef7-f883f1a8dbd9 for instance f68eb618-c745-43db-a873-7c0700c0f11c on hv-cinder-81803 Nov 20 03:25:01.723229 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-228c341f-8dd5-423b-a043-92fc27f7e469 req-fcf10122-f37f-4794-996c-cc444994288a service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029786 Nov 20 03:25:01.723832 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 77/140] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:25:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:25:01.764875 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-ee490c60-75e7-4f98-a831-b2e7dafbdb8d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:01.773610 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ee490c60-75e7-4f98-a831-b2e7dafbdb8d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1322 microversion: 2.1 time: 0.161587 Nov 20 03:25:01.778593 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 64/141] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:01 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:01.816259 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-60903f5e-0810-4179-be8f-8fa2ae0dbee4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89cbebf4-568f-41cb-a6d4-da9e07c3ad72"}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:01.817586 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-60903f5e-0810-4179-be8f-8fa2ae0dbee4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:01.823471 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-60903f5e-0810-4179-be8f-8fa2ae0dbee4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:01.823949 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-60903f5e-0810-4179-be8f-8fa2ae0dbee4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:01.824715 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-60903f5e-0810-4179-be8f-8fa2ae0dbee4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:01.825136 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-60903f5e-0810-4179-be8f-8fa2ae0dbee4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:02.643362 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ed58d09f-dea8-4a6a-bc5d-926142b9053c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:02.644554 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ed58d09f-dea8-4a6a-bc5d-926142b9053c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:02.660641 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ed58d09f-dea8-4a6a-bc5d-926142b9053c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:02.661658 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ed58d09f-dea8-4a6a-bc5d-926142b9053c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:02.663548 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ed58d09f-dea8-4a6a-bc5d-926142b9053c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:02.665770 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ed58d09f-dea8-4a6a-bc5d-926142b9053c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:02.799208 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-60903f5e-0810-4179-be8f-8fa2ae0dbee4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "POST /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.986801 Nov 20 03:25:02.807516 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 78/142] 10.222.0.37 () {60 vars in 1322 bytes} [Sat Nov 20 03:25:01 2021] POST /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77/os-volume_attachments => generated 194 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:25:02.807516 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-2dc3d1d5-50fa-40e8-aff3-c59ee8a9f545 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:02.807516 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-2dc3d1d5-50fa-40e8-aff3-c59ee8a9f545 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:02.813649 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2dc3d1d5-50fa-40e8-aff3-c59ee8a9f545 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:02.814317 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2dc3d1d5-50fa-40e8-aff3-c59ee8a9f545 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:02.815574 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2dc3d1d5-50fa-40e8-aff3-c59ee8a9f545 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:02.816517 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2dc3d1d5-50fa-40e8-aff3-c59ee8a9f545 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:03.077615 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-2dc3d1d5-50fa-40e8-aff3-c59ee8a9f545 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:03.084262 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-ed58d09f-dea8-4a6a-bc5d-926142b9053c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:03.085377 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-2dc3d1d5-50fa-40e8-aff3-c59ee8a9f545 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1516 microversion: 2.1 time: 0.283682 Nov 20 03:25:03.094368 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-ed58d09f-dea8-4a6a-bc5d-926142b9053c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:03.096077 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-ed58d09f-dea8-4a6a-bc5d-926142b9053c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:03.097400 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ed58d09f-dea8-4a6a-bc5d-926142b9053c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1407 microversion: 2.20 time: 0.464114 Nov 20 03:25:03.098079 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 65/143] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:25:02 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1407 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:25:03.100205 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 79/144] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:02 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1516 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:03.104342 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-dbea1c4f-23c7-47c2-80cd-b59268a48140 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:03.105590 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-dbea1c4f-23c7-47c2-80cd-b59268a48140 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:03.112324 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dbea1c4f-23c7-47c2-80cd-b59268a48140 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:03.112843 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dbea1c4f-23c7-47c2-80cd-b59268a48140 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:03.113691 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dbea1c4f-23c7-47c2-80cd-b59268a48140 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:03.114202 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dbea1c4f-23c7-47c2-80cd-b59268a48140 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:03.136297 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.objects.instance [None req-dbea1c4f-23c7-47c2-80cd-b59268a48140 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lazy-loading 'flavor' on Instance uuid 329637be-05e2-4b96-9709-c1b15f8f5f30 {{(pid=116113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 03:25:03.243405 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-dbea1c4f-23c7-47c2-80cd-b59268a48140 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "POST /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30/action" status: 200 len: 32 microversion: 2.1 time: 0.142668 Nov 20 03:25:03.247942 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 66/145] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:25:03 2021] POST /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30/action => generated 32 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 03:25:03.252932 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-c511096b-e78b-47cb-ba51-2e3719406966 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:03.253957 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-c511096b-e78b-47cb-ba51-2e3719406966 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:03.262481 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c511096b-e78b-47cb-ba51-2e3719406966 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:03.263331 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c511096b-e78b-47cb-ba51-2e3719406966 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:03.264226 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c511096b-e78b-47cb-ba51-2e3719406966 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:03.264672 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c511096b-e78b-47cb-ba51-2e3719406966 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:03.508159 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-c511096b-e78b-47cb-ba51-2e3719406966 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:03.517220 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-c511096b-e78b-47cb-ba51-2e3719406966 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1522 microversion: 2.1 time: 0.267905 Nov 20 03:25:03.517879 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 80/146] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:03 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:04.116481 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-c91e46b5-4412-400a-8d6f-60f2a09e36c7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:04.117170 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-c91e46b5-4412-400a-8d6f-60f2a09e36c7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:04.123058 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c91e46b5-4412-400a-8d6f-60f2a09e36c7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:04.123556 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c91e46b5-4412-400a-8d6f-60f2a09e36c7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:04.124349 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c91e46b5-4412-400a-8d6f-60f2a09e36c7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:04.125078 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c91e46b5-4412-400a-8d6f-60f2a09e36c7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:04.273320 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-c91e46b5-4412-400a-8d6f-60f2a09e36c7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:04.282068 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-c91e46b5-4412-400a-8d6f-60f2a09e36c7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:04.283575 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-c91e46b5-4412-400a-8d6f-60f2a09e36c7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:04.284751 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-c91e46b5-4412-400a-8d6f-60f2a09e36c7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1407 microversion: 2.20 time: 0.172286 Nov 20 03:25:04.285594 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 67/147] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:25:04 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:25:04.534901 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-5e18a648-7749-4fac-a513-6af48532c01e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:04.535563 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-5e18a648-7749-4fac-a513-6af48532c01e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:04.541763 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5e18a648-7749-4fac-a513-6af48532c01e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:04.542215 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5e18a648-7749-4fac-a513-6af48532c01e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:04.543051 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5e18a648-7749-4fac-a513-6af48532c01e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:04.543489 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5e18a648-7749-4fac-a513-6af48532c01e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:04.675020 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-5e18a648-7749-4fac-a513-6af48532c01e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:04.682560 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-5e18a648-7749-4fac-a513-6af48532c01e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1522 microversion: 2.1 time: 0.151294 Nov 20 03:25:04.683196 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 81/148] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:04 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:05.302138 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-9dfe77ad-ac46-4384-b88c-219f03bf5a21 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:05.302745 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-9dfe77ad-ac46-4384-b88c-219f03bf5a21 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:05.308921 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9dfe77ad-ac46-4384-b88c-219f03bf5a21 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:05.309370 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9dfe77ad-ac46-4384-b88c-219f03bf5a21 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:05.310143 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9dfe77ad-ac46-4384-b88c-219f03bf5a21 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:05.310582 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9dfe77ad-ac46-4384-b88c-219f03bf5a21 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:05.490890 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9dfe77ad-ac46-4384-b88c-219f03bf5a21 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:05.499154 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9dfe77ad-ac46-4384-b88c-219f03bf5a21 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:05.500814 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9dfe77ad-ac46-4384-b88c-219f03bf5a21 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:05.501835 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-9dfe77ad-ac46-4384-b88c-219f03bf5a21 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1407 microversion: 2.20 time: 0.203411 Nov 20 03:25:05.504601 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 68/149] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:25:05 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:25:05.703723 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-c659b264-818c-4684-a597-5f6b4dc8e6a2 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:05.704971 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-c659b264-818c-4684-a597-5f6b4dc8e6a2 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:05.716194 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c659b264-818c-4684-a597-5f6b4dc8e6a2 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:05.716904 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c659b264-818c-4684-a597-5f6b4dc8e6a2 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:05.717816 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c659b264-818c-4684-a597-5f6b4dc8e6a2 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:05.718538 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c659b264-818c-4684-a597-5f6b4dc8e6a2 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:05.870385 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-c659b264-818c-4684-a597-5f6b4dc8e6a2 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:05.879080 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-c659b264-818c-4684-a597-5f6b4dc8e6a2 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1522 microversion: 2.1 time: 0.182016 Nov 20 03:25:05.879972 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 82/150] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:05 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:06.521474 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-7404dd3a-9041-44c8-9779-d6bb090bb8c4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:06.522713 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-7404dd3a-9041-44c8-9779-d6bb090bb8c4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:06.530449 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7404dd3a-9041-44c8-9779-d6bb090bb8c4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:06.530894 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7404dd3a-9041-44c8-9779-d6bb090bb8c4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:06.531675 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7404dd3a-9041-44c8-9779-d6bb090bb8c4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:06.532132 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7404dd3a-9041-44c8-9779-d6bb090bb8c4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:06.788470 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-7404dd3a-9041-44c8-9779-d6bb090bb8c4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:06.796267 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-7404dd3a-9041-44c8-9779-d6bb090bb8c4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:06.797763 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-7404dd3a-9041-44c8-9779-d6bb090bb8c4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:06.798854 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-7404dd3a-9041-44c8-9779-d6bb090bb8c4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1407 microversion: 2.20 time: 0.281917 Nov 20 03:25:06.799402 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 69/151] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:25:06 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1407 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:25:06.896325 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-81261b44-95ce-4ade-955c-22476bf541e1 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:06.897550 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-81261b44-95ce-4ade-955c-22476bf541e1 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:06.905702 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-81261b44-95ce-4ade-955c-22476bf541e1 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:06.906540 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-81261b44-95ce-4ade-955c-22476bf541e1 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:06.907741 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-81261b44-95ce-4ade-955c-22476bf541e1 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:06.908341 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-81261b44-95ce-4ade-955c-22476bf541e1 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:07.131165 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-81261b44-95ce-4ade-955c-22476bf541e1 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:07.142010 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-81261b44-95ce-4ade-955c-22476bf541e1 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1522 microversion: 2.1 time: 0.248914 Nov 20 03:25:07.143823 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 83/152] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:06 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:07.816827 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-4c6b6769-6174-49d8-97f5-dfbebcccc546 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:07.817460 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-4c6b6769-6174-49d8-97f5-dfbebcccc546 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:07.824008 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4c6b6769-6174-49d8-97f5-dfbebcccc546 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:07.824504 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4c6b6769-6174-49d8-97f5-dfbebcccc546 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:07.825314 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4c6b6769-6174-49d8-97f5-dfbebcccc546 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:07.825749 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4c6b6769-6174-49d8-97f5-dfbebcccc546 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:07.964375 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-4c6b6769-6174-49d8-97f5-dfbebcccc546 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:07.976110 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-4c6b6769-6174-49d8-97f5-dfbebcccc546 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:07.977641 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-4c6b6769-6174-49d8-97f5-dfbebcccc546 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:07.978797 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-4c6b6769-6174-49d8-97f5-dfbebcccc546 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1599 microversion: 2.20 time: 0.165640 Nov 20 03:25:07.979428 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 70/153] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:25:07 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:25:08.000676 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-44bffb9b-bf4a-4933-8279-dd4ab3fd384b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:08.001160 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-44bffb9b-bf4a-4933-8279-dd4ab3fd384b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:08.007026 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-44bffb9b-bf4a-4933-8279-dd4ab3fd384b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:08.007476 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-44bffb9b-bf4a-4933-8279-dd4ab3fd384b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:08.008369 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-44bffb9b-bf4a-4933-8279-dd4ab3fd384b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:08.008774 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-44bffb9b-bf4a-4933-8279-dd4ab3fd384b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:08.105324 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-44bffb9b-bf4a-4933-8279-dd4ab3fd384b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.108667 Nov 20 03:25:08.106110 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 84/154] 10.222.0.37 () {60 vars in 1315 bytes} [Sat Nov 20 03:25:07 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:25:08.159865 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-09790cbf-0590-4a70-995e-1fd8ab6e0d45 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:08.160819 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-09790cbf-0590-4a70-995e-1fd8ab6e0d45 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:08.167536 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-09790cbf-0590-4a70-995e-1fd8ab6e0d45 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:08.170140 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-09790cbf-0590-4a70-995e-1fd8ab6e0d45 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:08.173188 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-09790cbf-0590-4a70-995e-1fd8ab6e0d45 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:08.174037 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-09790cbf-0590-4a70-995e-1fd8ab6e0d45 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:08.724825 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-09790cbf-0590-4a70-995e-1fd8ab6e0d45 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:08.734216 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-09790cbf-0590-4a70-995e-1fd8ab6e0d45 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1522 microversion: 2.1 time: 0.579554 Nov 20 03:25:08.734790 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 71/155] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:08 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1522 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:09.751337 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-dfa4f0c9-92d9-41f8-99ba-2d45565c6a22 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:09.752007 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-dfa4f0c9-92d9-41f8-99ba-2d45565c6a22 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:09.758972 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dfa4f0c9-92d9-41f8-99ba-2d45565c6a22 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:09.759426 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dfa4f0c9-92d9-41f8-99ba-2d45565c6a22 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:09.761338 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dfa4f0c9-92d9-41f8-99ba-2d45565c6a22 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:09.761787 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dfa4f0c9-92d9-41f8-99ba-2d45565c6a22 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:10.054251 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-b8af7561-b52a-4fff-897d-0538e513b5ab tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:10.055097 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-b8af7561-b52a-4fff-897d-0538e513b5ab tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:10.067378 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b8af7561-b52a-4fff-897d-0538e513b5ab tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:10.068427 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b8af7561-b52a-4fff-897d-0538e513b5ab tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:10.070186 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b8af7561-b52a-4fff-897d-0538e513b5ab tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:10.070867 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b8af7561-b52a-4fff-897d-0538e513b5ab tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:10.091596 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-dfa4f0c9-92d9-41f8-99ba-2d45565c6a22 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:10.104562 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-dfa4f0c9-92d9-41f8-99ba-2d45565c6a22 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1522 microversion: 2.1 time: 0.356724 Nov 20 03:25:10.105371 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 85/156] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:09 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:10.123703 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-bb20f331-4343-4abc-a28b-9895bc7422d2 req-2abeb5bb-ada7-4cd7-a67f-0423cb655493 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f68eb618-c745-43db-a873-7c0700c0f11c", "tag": "7a19e0fe-867b-45fc-9ef7-f883f1a8dbd9"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:10.126634 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:25:10.126634 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:25:10.139906 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-bb20f331-4343-4abc-a28b-9895bc7422d2 req-2abeb5bb-ada7-4cd7-a67f-0423cb655493 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:10.141693 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-bb20f331-4343-4abc-a28b-9895bc7422d2 req-2abeb5bb-ada7-4cd7-a67f-0423cb655493 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:10.166799 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-bb20f331-4343-4abc-a28b-9895bc7422d2 req-2abeb5bb-ada7-4cd7-a67f-0423cb655493 service nova] Creating event network-changed:7a19e0fe-867b-45fc-9ef7-f883f1a8dbd9 for instance f68eb618-c745-43db-a873-7c0700c0f11c on hv-cinder-81803 Nov 20 03:25:10.180464 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-bb20f331-4343-4abc-a28b-9895bc7422d2 req-2abeb5bb-ada7-4cd7-a67f-0423cb655493 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070520 Nov 20 03:25:10.181071 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 86/157] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:25:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:25:11.123359 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-81f95323-3fe3-4b77-8b83-c12e3a138bb6 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:11.124637 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-81f95323-3fe3-4b77-8b83-c12e3a138bb6 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:11.133981 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-81f95323-3fe3-4b77-8b83-c12e3a138bb6 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:11.134753 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-81f95323-3fe3-4b77-8b83-c12e3a138bb6 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:11.136035 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-81f95323-3fe3-4b77-8b83-c12e3a138bb6 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:11.137391 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-81f95323-3fe3-4b77-8b83-c12e3a138bb6 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:11.589435 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-81f95323-3fe3-4b77-8b83-c12e3a138bb6 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:11.598768 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-81f95323-3fe3-4b77-8b83-c12e3a138bb6 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1522 microversion: 2.1 time: 0.480867 Nov 20 03:25:11.599901 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 87/158] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:11 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1522 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:12.364400 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-b8af7561-b52a-4fff-897d-0538e513b5ab tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 14 microversion: 2.20 time: 2.313641 Nov 20 03:25:12.365893 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 72/159] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:25:10 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 14 bytes in 2318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:12.621960 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-72b71d63-34b7-458f-9515-c8b8f3e79f83 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:12.624289 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-72b71d63-34b7-458f-9515-c8b8f3e79f83 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:12.645950 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-72b71d63-34b7-458f-9515-c8b8f3e79f83 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:12.646802 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-72b71d63-34b7-458f-9515-c8b8f3e79f83 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:12.647885 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-72b71d63-34b7-458f-9515-c8b8f3e79f83 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:12.648647 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-72b71d63-34b7-458f-9515-c8b8f3e79f83 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:12.875987 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-72b71d63-34b7-458f-9515-c8b8f3e79f83 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:12.885010 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-72b71d63-34b7-458f-9515-c8b8f3e79f83 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1522 microversion: 2.1 time: 0.270039 Nov 20 03:25:12.888080 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 88/160] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:12 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:13.376227 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-4d2dc8e7-6538-4790-a0dc-5046d3342be1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:13.377309 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-4d2dc8e7-6538-4790-a0dc-5046d3342be1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:13.384137 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4d2dc8e7-6538-4790-a0dc-5046d3342be1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:13.384692 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4d2dc8e7-6538-4790-a0dc-5046d3342be1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:13.385572 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4d2dc8e7-6538-4790-a0dc-5046d3342be1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:13.386073 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4d2dc8e7-6538-4790-a0dc-5046d3342be1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:13.511771 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-4d2dc8e7-6538-4790-a0dc-5046d3342be1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 14 microversion: 2.20 time: 0.139427 Nov 20 03:25:13.512591 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 73/161] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:25:13 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:13.910962 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-31f984ae-5d9e-43df-a180-f0a137e0f158 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:13.911454 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-31f984ae-5d9e-43df-a180-f0a137e0f158 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:13.917930 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-31f984ae-5d9e-43df-a180-f0a137e0f158 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:13.918387 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-31f984ae-5d9e-43df-a180-f0a137e0f158 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:13.919303 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-31f984ae-5d9e-43df-a180-f0a137e0f158 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:13.919738 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-31f984ae-5d9e-43df-a180-f0a137e0f158 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:13.996913 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-837c4180-dda0-4818-9f7f-edb927a70c00 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:13.997695 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-837c4180-dda0-4818-9f7f-edb927a70c00 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:14.005503 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-837c4180-dda0-4818-9f7f-edb927a70c00 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:14.005979 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-837c4180-dda0-4818-9f7f-edb927a70c00 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:14.006769 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-837c4180-dda0-4818-9f7f-edb927a70c00 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:14.007198 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-837c4180-dda0-4818-9f7f-edb927a70c00 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:14.035687 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-837c4180-dda0-4818-9f7f-edb927a70c00 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Going to try to terminate instance {{(pid=116113) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 03:25:14.138415 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-837c4180-dda0-4818-9f7f-edb927a70c00 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "DELETE /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 204 len: 0 microversion: 2.1 time: 0.144810 Nov 20 03:25:14.139384 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-31f984ae-5d9e-43df-a180-f0a137e0f158 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:14.141659 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 74/162] 10.222.0.37 () {58 vars in 1238 bytes} [Sat Nov 20 03:25:13 2021] DELETE /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 03:25:14.146985 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-31f984ae-5d9e-43df-a180-f0a137e0f158 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1522 microversion: 2.1 time: 0.239602 Nov 20 03:25:14.148054 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 89/163] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:13 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:14.151491 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-a12a4f71-898d-4eaf-9950-be182cc4744f tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:14.152200 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-a12a4f71-898d-4eaf-9950-be182cc4744f tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:14.162086 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a12a4f71-898d-4eaf-9950-be182cc4744f tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:14.162847 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a12a4f71-898d-4eaf-9950-be182cc4744f tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:14.163778 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a12a4f71-898d-4eaf-9950-be182cc4744f tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:14.164383 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a12a4f71-898d-4eaf-9950-be182cc4744f tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:14.350089 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a12a4f71-898d-4eaf-9950-be182cc4744f tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:14.358465 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-a12a4f71-898d-4eaf-9950-be182cc4744f tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1555 microversion: 2.1 time: 0.210849 Nov 20 03:25:14.359033 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 75/164] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:14 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1555 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:14.523133 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-296c282f-8741-40d5-9ae6-79c198950da2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:14.524945 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-296c282f-8741-40d5-9ae6-79c198950da2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:14.532995 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-296c282f-8741-40d5-9ae6-79c198950da2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:14.533595 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-296c282f-8741-40d5-9ae6-79c198950da2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:14.535028 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-296c282f-8741-40d5-9ae6-79c198950da2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:14.535975 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-296c282f-8741-40d5-9ae6-79c198950da2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:15.165197 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-dfc17003-70f6-4c9d-b5d8-139e6feb123e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:15.165699 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-dfc17003-70f6-4c9d-b5d8-139e6feb123e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:15.172295 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dfc17003-70f6-4c9d-b5d8-139e6feb123e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:15.173007 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dfc17003-70f6-4c9d-b5d8-139e6feb123e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:15.173982 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dfc17003-70f6-4c9d-b5d8-139e6feb123e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:15.174414 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dfc17003-70f6-4c9d-b5d8-139e6feb123e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:15.315990 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-dfc17003-70f6-4c9d-b5d8-139e6feb123e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:15.323540 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-dfc17003-70f6-4c9d-b5d8-139e6feb123e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1522 microversion: 2.1 time: 0.162344 Nov 20 03:25:15.324329 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 76/165] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:15 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:15.375165 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-99dd0d4c-7eef-4f2f-b6a9-6d5f411cd830 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:15.375779 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-99dd0d4c-7eef-4f2f-b6a9-6d5f411cd830 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:15.381690 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-99dd0d4c-7eef-4f2f-b6a9-6d5f411cd830 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:15.382290 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-99dd0d4c-7eef-4f2f-b6a9-6d5f411cd830 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:15.383121 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-99dd0d4c-7eef-4f2f-b6a9-6d5f411cd830 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:15.383694 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-99dd0d4c-7eef-4f2f-b6a9-6d5f411cd830 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:15.532959 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-99dd0d4c-7eef-4f2f-b6a9-6d5f411cd830 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:15.541143 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-99dd0d4c-7eef-4f2f-b6a9-6d5f411cd830 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1555 microversion: 2.1 time: 0.169502 Nov 20 03:25:15.541741 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 77/166] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:15 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:16.341345 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ce8ff68d-8f24-4d3f-993c-a49d9674f8bf tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:16.342536 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ce8ff68d-8f24-4d3f-993c-a49d9674f8bf tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:16.348687 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ce8ff68d-8f24-4d3f-993c-a49d9674f8bf tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:16.349405 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ce8ff68d-8f24-4d3f-993c-a49d9674f8bf tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:16.350179 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ce8ff68d-8f24-4d3f-993c-a49d9674f8bf tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:16.350614 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ce8ff68d-8f24-4d3f-993c-a49d9674f8bf tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:16.487279 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-ce8ff68d-8f24-4d3f-993c-a49d9674f8bf tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:16.494509 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ce8ff68d-8f24-4d3f-993c-a49d9674f8bf tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1522 microversion: 2.1 time: 0.156982 Nov 20 03:25:16.495067 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 78/167] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:16 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:16.559318 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-0f1b1e17-e369-40e4-90b1-e77063b56006 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:16.560164 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-0f1b1e17-e369-40e4-90b1-e77063b56006 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:16.566649 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0f1b1e17-e369-40e4-90b1-e77063b56006 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:16.567105 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0f1b1e17-e369-40e4-90b1-e77063b56006 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:16.567917 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0f1b1e17-e369-40e4-90b1-e77063b56006 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:16.568357 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0f1b1e17-e369-40e4-90b1-e77063b56006 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:16.708775 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-0f1b1e17-e369-40e4-90b1-e77063b56006 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:16.716619 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-0f1b1e17-e369-40e4-90b1-e77063b56006 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1555 microversion: 2.1 time: 0.161637 Nov 20 03:25:16.717931 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 79/168] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:16 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:17.344866 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-296c282f-8741-40d5-9ae6-79c198950da2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 14 microversion: 2.20 time: 2.818678 Nov 20 03:25:17.344866 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 90/169] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:25:14 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 14 bytes in 2820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:17.511256 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-fffbafa1-1adc-4f10-825a-3ee80ced4799 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:17.512318 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-fffbafa1-1adc-4f10-825a-3ee80ced4799 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:17.519214 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fffbafa1-1adc-4f10-825a-3ee80ced4799 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:17.519664 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fffbafa1-1adc-4f10-825a-3ee80ced4799 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:17.520493 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fffbafa1-1adc-4f10-825a-3ee80ced4799 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:17.520957 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fffbafa1-1adc-4f10-825a-3ee80ced4799 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:17.649587 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-fffbafa1-1adc-4f10-825a-3ee80ced4799 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:17.657697 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-fffbafa1-1adc-4f10-825a-3ee80ced4799 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1522 microversion: 2.1 time: 0.149997 Nov 20 03:25:17.658263 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 80/170] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:17 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:17.734477 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-832ade4c-f68b-44de-bea5-cb2f8fe664ca tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:17.735174 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-832ade4c-f68b-44de-bea5-cb2f8fe664ca tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:17.741967 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-832ade4c-f68b-44de-bea5-cb2f8fe664ca tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:17.742415 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-832ade4c-f68b-44de-bea5-cb2f8fe664ca tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:17.743184 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-832ade4c-f68b-44de-bea5-cb2f8fe664ca tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:17.743614 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-832ade4c-f68b-44de-bea5-cb2f8fe664ca tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:17.872240 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-832ade4c-f68b-44de-bea5-cb2f8fe664ca tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:17.880865 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-832ade4c-f68b-44de-bea5-cb2f8fe664ca tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1555 microversion: 2.1 time: 0.150351 Nov 20 03:25:17.881427 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 91/171] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:17 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:18.347838 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-b3cd0af9-e741-42c4-981d-4448ba4dd067 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:18.348800 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-b3cd0af9-e741-42c4-981d-4448ba4dd067 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:18.355277 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b3cd0af9-e741-42c4-981d-4448ba4dd067 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:18.355726 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b3cd0af9-e741-42c4-981d-4448ba4dd067 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:18.356664 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b3cd0af9-e741-42c4-981d-4448ba4dd067 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:18.357065 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b3cd0af9-e741-42c4-981d-4448ba4dd067 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:18.674832 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-760480c4-dec7-4a43-a20b-16c0da13182f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:18.675439 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-760480c4-dec7-4a43-a20b-16c0da13182f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:18.681722 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-760480c4-dec7-4a43-a20b-16c0da13182f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:18.682173 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-760480c4-dec7-4a43-a20b-16c0da13182f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:18.682948 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-760480c4-dec7-4a43-a20b-16c0da13182f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:18.683383 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-760480c4-dec7-4a43-a20b-16c0da13182f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:18.812273 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-760480c4-dec7-4a43-a20b-16c0da13182f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:18.819379 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-760480c4-dec7-4a43-a20b-16c0da13182f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1522 microversion: 2.1 time: 0.148206 Nov 20 03:25:18.819966 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 92/172] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:18 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:18.898079 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-14decaf6-ddeb-4599-b194-01f298d8540a tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:18.898701 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-14decaf6-ddeb-4599-b194-01f298d8540a tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:18.905358 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-14decaf6-ddeb-4599-b194-01f298d8540a tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:18.905802 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-14decaf6-ddeb-4599-b194-01f298d8540a tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:18.906574 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-14decaf6-ddeb-4599-b194-01f298d8540a tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:18.907033 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-14decaf6-ddeb-4599-b194-01f298d8540a tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:19.032284 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-14decaf6-ddeb-4599-b194-01f298d8540a tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:19.039941 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-14decaf6-ddeb-4599-b194-01f298d8540a tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1555 microversion: 2.1 time: 0.145459 Nov 20 03:25:19.040504 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 93/173] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:18 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1555 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:19.836127 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-21972ad3-7fb4-4e05-a76f-94c62e04de3d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:19.836735 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-21972ad3-7fb4-4e05-a76f-94c62e04de3d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:19.842914 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-21972ad3-7fb4-4e05-a76f-94c62e04de3d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:19.843354 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-21972ad3-7fb4-4e05-a76f-94c62e04de3d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:19.844158 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-21972ad3-7fb4-4e05-a76f-94c62e04de3d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:19.844582 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-21972ad3-7fb4-4e05-a76f-94c62e04de3d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:19.972784 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-21972ad3-7fb4-4e05-a76f-94c62e04de3d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:19.980267 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-21972ad3-7fb4-4e05-a76f-94c62e04de3d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1522 microversion: 2.1 time: 0.147782 Nov 20 03:25:19.980826 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 94/174] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:19 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:20.055761 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-08c6ca26-6d57-4c58-bd39-a8d33ff9da91 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:20.056377 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-08c6ca26-6d57-4c58-bd39-a8d33ff9da91 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:20.062716 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-08c6ca26-6d57-4c58-bd39-a8d33ff9da91 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:20.063153 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-08c6ca26-6d57-4c58-bd39-a8d33ff9da91 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:20.063943 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-08c6ca26-6d57-4c58-bd39-a8d33ff9da91 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:20.064374 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-08c6ca26-6d57-4c58-bd39-a8d33ff9da91 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:20.193189 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-08c6ca26-6d57-4c58-bd39-a8d33ff9da91 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:20.201187 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-08c6ca26-6d57-4c58-bd39-a8d33ff9da91 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1555 microversion: 2.1 time: 0.148766 Nov 20 03:25:20.201767 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 95/175] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:20 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:20.997302 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-0f377851-e74e-427e-935e-5c8a6dc257f9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:20.997931 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-0f377851-e74e-427e-935e-5c8a6dc257f9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:21.004168 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0f377851-e74e-427e-935e-5c8a6dc257f9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:21.004614 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0f377851-e74e-427e-935e-5c8a6dc257f9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:21.005375 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0f377851-e74e-427e-935e-5c8a6dc257f9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:21.005800 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0f377851-e74e-427e-935e-5c8a6dc257f9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:21.131390 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-0f377851-e74e-427e-935e-5c8a6dc257f9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:21.139230 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-0f377851-e74e-427e-935e-5c8a6dc257f9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1522 microversion: 2.1 time: 0.144975 Nov 20 03:25:21.139822 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 96/176] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:20 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:21.218178 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-e95bd7ea-132e-4666-bfda-190d0e5ecd15 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:21.218780 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-e95bd7ea-132e-4666-bfda-190d0e5ecd15 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:21.224727 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e95bd7ea-132e-4666-bfda-190d0e5ecd15 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:21.225170 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e95bd7ea-132e-4666-bfda-190d0e5ecd15 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:21.226005 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e95bd7ea-132e-4666-bfda-190d0e5ecd15 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:21.226420 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e95bd7ea-132e-4666-bfda-190d0e5ecd15 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:21.308151 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-b3cd0af9-e741-42c4-981d-4448ba4dd067 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 14 microversion: 2.20 time: 2.963866 Nov 20 03:25:21.311636 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 81/177] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:25:18 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 14 bytes in 2965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:21.354950 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-e95bd7ea-132e-4666-bfda-190d0e5ecd15 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:21.362899 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-e95bd7ea-132e-4666-bfda-190d0e5ecd15 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1555 microversion: 2.1 time: 0.148594 Nov 20 03:25:21.363471 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 97/178] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:21 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:22.157072 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-823e3efe-7d7f-47e1-9a7f-149d24baf9ae tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:22.157757 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-823e3efe-7d7f-47e1-9a7f-149d24baf9ae tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:22.164467 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-823e3efe-7d7f-47e1-9a7f-149d24baf9ae tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:22.164905 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-823e3efe-7d7f-47e1-9a7f-149d24baf9ae tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:22.165675 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-823e3efe-7d7f-47e1-9a7f-149d24baf9ae tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:22.166101 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-823e3efe-7d7f-47e1-9a7f-149d24baf9ae tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:22.299457 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-823e3efe-7d7f-47e1-9a7f-149d24baf9ae tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:22.308511 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-823e3efe-7d7f-47e1-9a7f-149d24baf9ae tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1522 microversion: 2.1 time: 0.155817 Nov 20 03:25:22.309270 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 82/179] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:22 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:22.325301 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-0e84e5d8-8dcf-4652-81ba-92e5f89b4bc7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:22.326986 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-0e84e5d8-8dcf-4652-81ba-92e5f89b4bc7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:22.333666 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0e84e5d8-8dcf-4652-81ba-92e5f89b4bc7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:22.334939 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0e84e5d8-8dcf-4652-81ba-92e5f89b4bc7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:22.335799 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0e84e5d8-8dcf-4652-81ba-92e5f89b4bc7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:22.336629 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0e84e5d8-8dcf-4652-81ba-92e5f89b4bc7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:22.379177 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-a221dc8a-0c9b-4b9b-ab31-b150c431ef5c tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:22.379852 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-a221dc8a-0c9b-4b9b-ab31-b150c431ef5c tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:22.385597 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a221dc8a-0c9b-4b9b-ab31-b150c431ef5c tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:22.386078 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a221dc8a-0c9b-4b9b-ab31-b150c431ef5c tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:22.386851 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a221dc8a-0c9b-4b9b-ab31-b150c431ef5c tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:22.387289 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a221dc8a-0c9b-4b9b-ab31-b150c431ef5c tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:22.521496 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a221dc8a-0c9b-4b9b-ab31-b150c431ef5c tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:22.525935 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-0e84e5d8-8dcf-4652-81ba-92e5f89b4bc7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 14 microversion: 2.20 time: 0.203060 Nov 20 03:25:22.527279 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 98/180] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:25:22 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 14 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:22.537867 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-a221dc8a-0c9b-4b9b-ab31-b150c431ef5c tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1555 microversion: 2.1 time: 0.162129 Nov 20 03:25:22.538491 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 83/181] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:22 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:23.327185 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-6167340c-4219-47c6-b340-3a4155e6229e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:23.328071 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-6167340c-4219-47c6-b340-3a4155e6229e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:23.335315 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6167340c-4219-47c6-b340-3a4155e6229e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:23.335763 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6167340c-4219-47c6-b340-3a4155e6229e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:23.336564 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6167340c-4219-47c6-b340-3a4155e6229e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:23.336995 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6167340c-4219-47c6-b340-3a4155e6229e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:23.480534 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-6167340c-4219-47c6-b340-3a4155e6229e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:23.488600 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-6167340c-4219-47c6-b340-3a4155e6229e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1522 microversion: 2.1 time: 0.165792 Nov 20 03:25:23.489097 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 99/182] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:23 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:23.539183 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-3a9d5216-ec09-4e33-87ad-1929aa5e5ac5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:23.540720 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-3a9d5216-ec09-4e33-87ad-1929aa5e5ac5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:23.548349 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3a9d5216-ec09-4e33-87ad-1929aa5e5ac5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:23.548785 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3a9d5216-ec09-4e33-87ad-1929aa5e5ac5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:23.549748 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3a9d5216-ec09-4e33-87ad-1929aa5e5ac5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:23.551354 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3a9d5216-ec09-4e33-87ad-1929aa5e5ac5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:23.556026 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-b3544507-e5bc-4df4-be0a-e0c7643f3f87 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:23.556502 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-b3544507-e5bc-4df4-be0a-e0c7643f3f87 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:23.563572 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b3544507-e5bc-4df4-be0a-e0c7643f3f87 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:23.564163 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b3544507-e5bc-4df4-be0a-e0c7643f3f87 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:23.565088 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b3544507-e5bc-4df4-be0a-e0c7643f3f87 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:23.565599 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b3544507-e5bc-4df4-be0a-e0c7643f3f87 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:23.701758 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-b3544507-e5bc-4df4-be0a-e0c7643f3f87 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:23.709392 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-b3544507-e5bc-4df4-be0a-e0c7643f3f87 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1555 microversion: 2.1 time: 0.157900 Nov 20 03:25:23.709952 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 100/183] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:23 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:23.714139 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-c7fdb847-11a9-4469-b5a1-2b50afb24dbf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-346454204", "imageRef": "e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0", "flavorRef": "452", "networks": [{"uuid": "a1acacc5-2d91-42ad-971f-cecd3a0dc9a5"}]}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:23.770484 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.network.neutron [None req-c7fdb847-11a9-4469-b5a1-2b50afb24dbf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] validate_networks() for [('a1acacc5-2d91-42ad-971f-cecd3a0dc9a5', None, None, None, None, None)] {{(pid=116114) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 03:25:24.242096 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-c7fdb847-11a9-4469-b5a1-2b50afb24dbf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Flavor limits 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 03:25:24.242528 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-c7fdb847-11a9-4469-b5a1-2b50afb24dbf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Image limits 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 03:25:24.243120 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-c7fdb847-11a9-4469-b5a1-2b50afb24dbf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Flavor pref 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 03:25:24.243522 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-c7fdb847-11a9-4469-b5a1-2b50afb24dbf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Image pref 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 03:25:24.243961 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-c7fdb847-11a9-4469-b5a1-2b50afb24dbf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 03:25:24.253506 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c7fdb847-11a9-4469-b5a1-2b50afb24dbf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:24.253940 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c7fdb847-11a9-4469-b5a1-2b50afb24dbf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:24.254737 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c7fdb847-11a9-4469-b5a1-2b50afb24dbf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:24.255162 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c7fdb847-11a9-4469-b5a1-2b50afb24dbf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:24.271369 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-c7fdb847-11a9-4469-b5a1-2b50afb24dbf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Getting quotas for project 0fdf6e7abf574b269f3c1459a9d58c26. Resources: {'ram', 'cores', 'instances'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:25:24.275452 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-c7fdb847-11a9-4469-b5a1-2b50afb24dbf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Getting quotas for user e05b767f39ea49e4aa916c818a4290e7 and project 0fdf6e7abf574b269f3c1459a9d58c26. Resources: {'ram', 'cores', 'instances'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:25:24.290832 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-c7fdb847-11a9-4469-b5a1-2b50afb24dbf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Going to run 1 instances... {{(pid=116114) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 03:25:24.293153 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-c7fdb847-11a9-4469-b5a1-2b50afb24dbf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: f99425ad-063b-41de-ada4-431531d73cf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 03:25:24.338498 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-c7fdb847-11a9-4469-b5a1-2b50afb24dbf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.627508 Nov 20 03:25:24.339964 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 101/184] 10.222.0.37 () {60 vars in 1146 bytes} [Sat Nov 20 03:25:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 03:25:24.363078 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-fbe8cd67-66f7-4281-9e0a-ac4388fe132f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:24.364001 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-fbe8cd67-66f7-4281-9e0a-ac4388fe132f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: f99425ad-063b-41de-ada4-431531d73cf9] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:24.426344 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-fbe8cd67-66f7-4281-9e0a-ac4388fe132f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:24.434139 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-fbe8cd67-66f7-4281-9e0a-ac4388fe132f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9" status: 200 len: 1217 microversion: 2.1 time: 0.083799 Nov 20 03:25:24.434833 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 102/185] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:24 2021] GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:24.505166 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-27c16869-069e-469a-8384-ad5a64ab8986 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:24.505772 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-27c16869-069e-469a-8384-ad5a64ab8986 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:24.511636 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-27c16869-069e-469a-8384-ad5a64ab8986 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:24.512786 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-27c16869-069e-469a-8384-ad5a64ab8986 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:24.513613 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-27c16869-069e-469a-8384-ad5a64ab8986 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:24.514045 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-27c16869-069e-469a-8384-ad5a64ab8986 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:24.654005 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-27c16869-069e-469a-8384-ad5a64ab8986 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:24.663334 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-27c16869-069e-469a-8384-ad5a64ab8986 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1522 microversion: 2.1 time: 0.159749 Nov 20 03:25:24.663334 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 103/186] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:24 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:24.726685 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-226ee567-1f08-437f-b7ce-fa44b4a2e4ee tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:24.727306 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-226ee567-1f08-437f-b7ce-fa44b4a2e4ee tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:24.734430 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-226ee567-1f08-437f-b7ce-fa44b4a2e4ee tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:24.734940 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-226ee567-1f08-437f-b7ce-fa44b4a2e4ee tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:24.735761 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-226ee567-1f08-437f-b7ce-fa44b4a2e4ee tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:24.736226 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-226ee567-1f08-437f-b7ce-fa44b4a2e4ee tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:24.886888 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-226ee567-1f08-437f-b7ce-fa44b4a2e4ee tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:24.894765 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-226ee567-1f08-437f-b7ce-fa44b4a2e4ee tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1555 microversion: 2.1 time: 0.172292 Nov 20 03:25:24.895638 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 104/187] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:24 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:25.452084 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-0df0fdfe-1c57-4dc1-9476-79e6634f0bde tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:25.453441 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-0df0fdfe-1c57-4dc1-9476-79e6634f0bde tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: f99425ad-063b-41de-ada4-431531d73cf9] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:25.460367 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0df0fdfe-1c57-4dc1-9476-79e6634f0bde tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:25.460904 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0df0fdfe-1c57-4dc1-9476-79e6634f0bde tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:25.461971 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0df0fdfe-1c57-4dc1-9476-79e6634f0bde tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:25.462480 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0df0fdfe-1c57-4dc1-9476-79e6634f0bde tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:25.551987 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-0df0fdfe-1c57-4dc1-9476-79e6634f0bde tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:25.560752 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-0df0fdfe-1c57-4dc1-9476-79e6634f0bde tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9" status: 200 len: 1221 microversion: 2.1 time: 0.112939 Nov 20 03:25:25.561328 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 105/188] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:25 2021] GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9 => generated 1221 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:25.678129 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-5b669988-0bca-486c-9ac9-789c7394c84f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:25.678767 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-5b669988-0bca-486c-9ac9-789c7394c84f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:25.684505 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5b669988-0bca-486c-9ac9-789c7394c84f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:25.684955 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5b669988-0bca-486c-9ac9-789c7394c84f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:25.686217 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5b669988-0bca-486c-9ac9-789c7394c84f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:25.686647 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5b669988-0bca-486c-9ac9-789c7394c84f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:25.945050 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-5b669988-0bca-486c-9ac9-789c7394c84f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:25.953350 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-5b669988-0bca-486c-9ac9-789c7394c84f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1522 microversion: 2.1 time: 0.278810 Nov 20 03:25:25.954168 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 106/189] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:25 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:25.958672 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-b97a5b37-fbaf-43fa-902d-1d7d0524c12f tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:25.959420 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-b97a5b37-fbaf-43fa-902d-1d7d0524c12f tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:25.973615 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b97a5b37-fbaf-43fa-902d-1d7d0524c12f tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:25.974320 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b97a5b37-fbaf-43fa-902d-1d7d0524c12f tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:25.975268 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b97a5b37-fbaf-43fa-902d-1d7d0524c12f tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:25.975946 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b97a5b37-fbaf-43fa-902d-1d7d0524c12f tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:26.121393 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-3a9d5216-ec09-4e33-87ad-1929aa5e5ac5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 14558 microversion: 2.20 time: 2.583193 Nov 20 03:25:26.123328 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 84/190] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:25:23 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 14558 bytes in 2588 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:25:26.193547 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-b97a5b37-fbaf-43fa-902d-1d7d0524c12f tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:26.201926 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-b97a5b37-fbaf-43fa-902d-1d7d0524c12f tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1555 microversion: 2.1 time: 0.246624 Nov 20 03:25:26.202501 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 107/191] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:25 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1555 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:26.578449 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-20b5478f-f6c1-4a0a-b90e-ef4c55c528d5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:26.579164 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-20b5478f-f6c1-4a0a-b90e-ef4c55c528d5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: f99425ad-063b-41de-ada4-431531d73cf9] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:26.586004 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-20b5478f-f6c1-4a0a-b90e-ef4c55c528d5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:26.586437 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-20b5478f-f6c1-4a0a-b90e-ef4c55c528d5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:26.587215 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-20b5478f-f6c1-4a0a-b90e-ef4c55c528d5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:26.587642 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-20b5478f-f6c1-4a0a-b90e-ef4c55c528d5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:26.717445 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-20b5478f-f6c1-4a0a-b90e-ef4c55c528d5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:26.726904 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-20b5478f-f6c1-4a0a-b90e-ef4c55c528d5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9" status: 200 len: 1269 microversion: 2.1 time: 0.152572 Nov 20 03:25:26.727408 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 85/192] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:26 2021] GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9 => generated 1269 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:26.970162 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-d36d1f09-86ea-4421-81aa-48c89239795d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:26.971364 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-d36d1f09-86ea-4421-81aa-48c89239795d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:26.978633 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d36d1f09-86ea-4421-81aa-48c89239795d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:26.979295 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d36d1f09-86ea-4421-81aa-48c89239795d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:26.980294 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d36d1f09-86ea-4421-81aa-48c89239795d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:26.980905 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d36d1f09-86ea-4421-81aa-48c89239795d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:27.135151 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-a48aba92-c1ce-4c1e-8625-8b017d772756 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:27.137613 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-a48aba92-c1ce-4c1e-8625-8b017d772756 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:27.146804 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a48aba92-c1ce-4c1e-8625-8b017d772756 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:27.147541 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a48aba92-c1ce-4c1e-8625-8b017d772756 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:27.148508 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a48aba92-c1ce-4c1e-8625-8b017d772756 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:27.149088 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a48aba92-c1ce-4c1e-8625-8b017d772756 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:27.286416 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-a48aba92-c1ce-4c1e-8625-8b017d772756 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 17195 microversion: 2.20 time: 0.157010 Nov 20 03:25:27.287645 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 86/193] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:25:27 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 17195 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 03:25:27.293807 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-52492761-38e0-439d-8b4c-bb4997ee767e tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:27.295508 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-52492761-38e0-439d-8b4c-bb4997ee767e tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:27.303316 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-52492761-38e0-439d-8b4c-bb4997ee767e tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:27.304028 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-52492761-38e0-439d-8b4c-bb4997ee767e tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:27.305319 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-52492761-38e0-439d-8b4c-bb4997ee767e tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:27.307007 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-52492761-38e0-439d-8b4c-bb4997ee767e tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:27.537146 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-d36d1f09-86ea-4421-81aa-48c89239795d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:27.546019 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-d36d1f09-86ea-4421-81aa-48c89239795d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1522 microversion: 2.1 time: 0.579371 Nov 20 03:25:27.546805 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 108/194] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:26 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1522 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:27.748631 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-773f25c3-db09-4088-89b6-1c783d0dd069 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:27.749156 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-773f25c3-db09-4088-89b6-1c783d0dd069 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: f99425ad-063b-41de-ada4-431531d73cf9] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:27.756852 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-773f25c3-db09-4088-89b6-1c783d0dd069 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:27.757314 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-773f25c3-db09-4088-89b6-1c783d0dd069 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:27.758103 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-773f25c3-db09-4088-89b6-1c783d0dd069 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:27.758536 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-773f25c3-db09-4088-89b6-1c783d0dd069 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:27.821338 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-52492761-38e0-439d-8b4c-bb4997ee767e tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:27.833073 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-52492761-38e0-439d-8b4c-bb4997ee767e tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1555 microversion: 2.1 time: 0.543834 Nov 20 03:25:27.835190 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 87/195] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:27 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1555 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:27.864014 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-fc83d87e-f5e2-468e-bec4-c72a9df82f49 req-d1b4326a-982e-4c3f-9c46-685e249b1640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459573a2-39ec-47c3-8815-297d17954f29", "name": "network-vif-deleted", "tag": "aabfdd18-ae62-4c81-b28d-067cee7510cd"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:27.864680 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-773f25c3-db09-4088-89b6-1c783d0dd069 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:27.866552 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:25:27.866552 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:25:27.876236 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-fc83d87e-f5e2-468e-bec4-c72a9df82f49 req-d1b4326a-982e-4c3f-9c46-685e249b1640 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:27.877176 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-fc83d87e-f5e2-468e-bec4-c72a9df82f49 req-d1b4326a-982e-4c3f-9c46-685e249b1640 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:27.881327 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-773f25c3-db09-4088-89b6-1c783d0dd069 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9" status: 200 len: 1275 microversion: 2.1 time: 0.140592 Nov 20 03:25:27.881973 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 109/196] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:27 2021] GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9 => generated 1275 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:27.913548 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-fc83d87e-f5e2-468e-bec4-c72a9df82f49 req-d1b4326a-982e-4c3f-9c46-685e249b1640 service nova] Creating event network-vif-deleted:aabfdd18-ae62-4c81-b28d-067cee7510cd for instance 459573a2-39ec-47c3-8815-297d17954f29 on hv-cinder-81803 Nov 20 03:25:27.919883 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-fc83d87e-f5e2-468e-bec4-c72a9df82f49 req-d1b4326a-982e-4c3f-9c46-685e249b1640 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060175 Nov 20 03:25:27.920734 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 88/197] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:25:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:25:28.298366 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-cfdfcf35-0b25-455d-8c29-4c46e004217f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:28.300139 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-cfdfcf35-0b25-455d-8c29-4c46e004217f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:28.307178 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cfdfcf35-0b25-455d-8c29-4c46e004217f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:28.307635 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cfdfcf35-0b25-455d-8c29-4c46e004217f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:28.308461 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cfdfcf35-0b25-455d-8c29-4c46e004217f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:28.308901 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cfdfcf35-0b25-455d-8c29-4c46e004217f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:28.564485 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-a99a4b66-0e9f-483c-8843-92e1ce13807e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:28.565789 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-a99a4b66-0e9f-483c-8843-92e1ce13807e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:28.575967 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a99a4b66-0e9f-483c-8843-92e1ce13807e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:28.579124 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a99a4b66-0e9f-483c-8843-92e1ce13807e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:28.589672 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a99a4b66-0e9f-483c-8843-92e1ce13807e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:28.590310 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a99a4b66-0e9f-483c-8843-92e1ce13807e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:28.944991 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a99a4b66-0e9f-483c-8843-92e1ce13807e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:28.953292 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-a99a4b66-0e9f-483c-8843-92e1ce13807e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1522 microversion: 2.1 time: 0.393224 Nov 20 03:25:28.953868 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 89/198] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:28 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:28.966162 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-b39bdba0-b8d2-4d7b-a76e-cdb24e4c2521 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:28.967310 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-b39bdba0-b8d2-4d7b-a76e-cdb24e4c2521 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:28.974184 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b39bdba0-b8d2-4d7b-a76e-cdb24e4c2521 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:28.974631 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b39bdba0-b8d2-4d7b-a76e-cdb24e4c2521 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:28.975407 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b39bdba0-b8d2-4d7b-a76e-cdb24e4c2521 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:28.975867 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b39bdba0-b8d2-4d7b-a76e-cdb24e4c2521 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:29.062983 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-b39bdba0-b8d2-4d7b-a76e-cdb24e4c2521 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:29.070713 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-b39bdba0-b8d2-4d7b-a76e-cdb24e4c2521 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1513 microversion: 2.1 time: 0.115722 Nov 20 03:25:29.071284 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 90/199] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:28 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1513 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:29.076325 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-22973de4-1b46-481d-9e19-30c5363d8290 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:29.077199 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-22973de4-1b46-481d-9e19-30c5363d8290 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: f99425ad-063b-41de-ada4-431531d73cf9] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:29.084107 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-22973de4-1b46-481d-9e19-30c5363d8290 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:29.084745 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-22973de4-1b46-481d-9e19-30c5363d8290 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:29.085825 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-22973de4-1b46-481d-9e19-30c5363d8290 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:29.086480 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-22973de4-1b46-481d-9e19-30c5363d8290 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:29.162941 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-22973de4-1b46-481d-9e19-30c5363d8290 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:29.187947 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-22973de4-1b46-481d-9e19-30c5363d8290 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9" status: 200 len: 1275 microversion: 2.1 time: 0.114820 Nov 20 03:25:29.193586 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 91/200] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:29 2021] GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9 => generated 1275 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:29.975280 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-92062c5e-c164-4722-bdc4-3923f7259fa7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:29.978875 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-92062c5e-c164-4722-bdc4-3923f7259fa7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:29.986999 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-92062c5e-c164-4722-bdc4-3923f7259fa7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:29.987519 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-92062c5e-c164-4722-bdc4-3923f7259fa7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:29.988716 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-92062c5e-c164-4722-bdc4-3923f7259fa7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:29.988982 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-92062c5e-c164-4722-bdc4-3923f7259fa7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:30.232480 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-92062c5e-c164-4722-bdc4-3923f7259fa7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:30.241655 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-92062c5e-c164-4722-bdc4-3923f7259fa7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1522 microversion: 2.1 time: 0.275382 Nov 20 03:25:30.242250 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 92/201] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:29 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:30.246928 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-e2bc1060-b3e0-4412-b314-d7aa8f4fa8de tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:30.247629 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-e2bc1060-b3e0-4412-b314-d7aa8f4fa8de tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:30.253900 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e2bc1060-b3e0-4412-b314-d7aa8f4fa8de tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:30.254364 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e2bc1060-b3e0-4412-b314-d7aa8f4fa8de tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:30.255305 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e2bc1060-b3e0-4412-b314-d7aa8f4fa8de tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:30.255746 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e2bc1060-b3e0-4412-b314-d7aa8f4fa8de tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:30.387256 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-e2bc1060-b3e0-4412-b314-d7aa8f4fa8de tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:30.401229 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-e2bc1060-b3e0-4412-b314-d7aa8f4fa8de tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1513 microversion: 2.1 time: 0.157690 Nov 20 03:25:30.401588 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 93/202] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:30 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:30.413670 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-a2836c05-113e-4fe9-93be-2e73055720a3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:30.414253 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-a2836c05-113e-4fe9-93be-2e73055720a3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: f99425ad-063b-41de-ada4-431531d73cf9] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:30.425946 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a2836c05-113e-4fe9-93be-2e73055720a3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:30.426684 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a2836c05-113e-4fe9-93be-2e73055720a3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:30.427871 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a2836c05-113e-4fe9-93be-2e73055720a3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:30.428519 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a2836c05-113e-4fe9-93be-2e73055720a3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:30.523169 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-cfdfcf35-0b25-455d-8c29-4c46e004217f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 20270 microversion: 2.20 time: 2.229063 Nov 20 03:25:30.527240 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 110/203] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:25:28 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 20270 bytes in 2231 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 03:25:30.536197 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a2836c05-113e-4fe9-93be-2e73055720a3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:30.543924 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-a2836c05-113e-4fe9-93be-2e73055720a3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9" status: 200 len: 1275 microversion: 2.1 time: 0.134009 Nov 20 03:25:30.544879 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 94/204] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:30 2021] GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9 => generated 1275 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:31.259493 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-72752bf0-5da2-4094-9285-278ddbb9e978 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:31.260545 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-72752bf0-5da2-4094-9285-278ddbb9e978 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:31.270532 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-72752bf0-5da2-4094-9285-278ddbb9e978 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:31.271314 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-72752bf0-5da2-4094-9285-278ddbb9e978 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:31.272898 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-72752bf0-5da2-4094-9285-278ddbb9e978 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:31.273582 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-72752bf0-5da2-4094-9285-278ddbb9e978 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:31.418285 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-99b7b50d-647f-4ff6-a04e-c21fade61537 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:31.419437 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-99b7b50d-647f-4ff6-a04e-c21fade61537 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:31.436457 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-99b7b50d-647f-4ff6-a04e-c21fade61537 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:31.439427 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-99b7b50d-647f-4ff6-a04e-c21fade61537 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:31.443115 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-99b7b50d-647f-4ff6-a04e-c21fade61537 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:31.453180 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-99b7b50d-647f-4ff6-a04e-c21fade61537 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:31.516128 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-99b7b50d-647f-4ff6-a04e-c21fade61537 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:31.516585 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-99b7b50d-647f-4ff6-a04e-c21fade61537 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:31.517043 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.objects.instance [None req-99b7b50d-647f-4ff6-a04e-c21fade61537 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lazy-loading 'fault' on Instance uuid 459573a2-39ec-47c3-8815-297d17954f29 {{(pid=116113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 03:25:31.652118 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-99b7b50d-647f-4ff6-a04e-c21fade61537 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f56de24d6214bb8bd0d4e86beca830c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1bfbb0ec4c3aa4eece7894279f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:31.661935 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-99b7b50d-647f-4ff6-a04e-c21fade61537 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 200 len: 1351 microversion: 2.1 time: 0.247429 Nov 20 03:25:31.673696 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 95/205] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:31 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 1351 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:31.689658 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-eed05c78-04fd-4cad-b013-c391b65d2884 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:31.691673 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-eed05c78-04fd-4cad-b013-c391b65d2884 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:31.706864 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-eed05c78-04fd-4cad-b013-c391b65d2884 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:31.707541 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-eed05c78-04fd-4cad-b013-c391b65d2884 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:31.708518 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-eed05c78-04fd-4cad-b013-c391b65d2884 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:31.709919 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-eed05c78-04fd-4cad-b013-c391b65d2884 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:31.911084 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-72752bf0-5da2-4094-9285-278ddbb9e978 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:31.914105 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-eed05c78-04fd-4cad-b013-c391b65d2884 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 21965 microversion: 2.20 time: 0.236590 Nov 20 03:25:31.915452 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 96/206] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:25:31 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 21965 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:25:31.920849 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-72752bf0-5da2-4094-9285-278ddbb9e978 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1522 microversion: 2.1 time: 0.665894 Nov 20 03:25:31.931867 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 111/207] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:31 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1522 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:31.933636 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-602cf832-6862-4c1a-a184-d71cbe00f620 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:31.934636 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-602cf832-6862-4c1a-a184-d71cbe00f620 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: f99425ad-063b-41de-ada4-431531d73cf9] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:31.944873 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-602cf832-6862-4c1a-a184-d71cbe00f620 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:31.945616 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-602cf832-6862-4c1a-a184-d71cbe00f620 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:31.946575 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-602cf832-6862-4c1a-a184-d71cbe00f620 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:31.947157 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-602cf832-6862-4c1a-a184-d71cbe00f620 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:32.519579 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-602cf832-6862-4c1a-a184-d71cbe00f620 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:32.532162 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-602cf832-6862-4c1a-a184-d71cbe00f620 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9" status: 200 len: 1317 microversion: 2.1 time: 0.612476 Nov 20 03:25:32.534090 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 97/208] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:31 2021] GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9 => generated 1317 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:32.680216 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-3167f361-6e04-4bf5-a932-ebdd21fd6569 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:32.680919 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-3167f361-6e04-4bf5-a932-ebdd21fd6569 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:32.692124 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3167f361-6e04-4bf5-a932-ebdd21fd6569 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:32.694318 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3167f361-6e04-4bf5-a932-ebdd21fd6569 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:32.696143 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3167f361-6e04-4bf5-a932-ebdd21fd6569 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:32.697640 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3167f361-6e04-4bf5-a932-ebdd21fd6569 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:32.738695 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.wsgi [None req-3167f361-6e04-4bf5-a932-ebdd21fd6569 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] HTTP exception thrown: Instance 459573a2-39ec-47c3-8815-297d17954f29 could not be found. Nov 20 03:25:32.740417 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-3167f361-6e04-4bf5-a932-ebdd21fd6569 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Returning 404 to user: Instance 459573a2-39ec-47c3-8815-297d17954f29 could not be found. {{(pid=116114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:25:32.743214 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-3167f361-6e04-4bf5-a932-ebdd21fd6569 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 404 len: 111 microversion: 2.1 time: 0.066161 Nov 20 03:25:32.748801 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 112/209] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:32 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:25:32.929123 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-9a66fa39-5ed4-437c-9abc-05a3fc3c8524 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:32.930290 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-9a66fa39-5ed4-437c-9abc-05a3fc3c8524 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:32.940419 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-dba38c27-b6b2-4a5b-957c-0b4c416e2e9e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:32.941596 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-dba38c27-b6b2-4a5b-957c-0b4c416e2e9e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:32.957345 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dba38c27-b6b2-4a5b-957c-0b4c416e2e9e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:32.962056 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9a66fa39-5ed4-437c-9abc-05a3fc3c8524 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:32.976155 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dba38c27-b6b2-4a5b-957c-0b4c416e2e9e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:32.978612 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dba38c27-b6b2-4a5b-957c-0b4c416e2e9e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:32.983564 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9a66fa39-5ed4-437c-9abc-05a3fc3c8524 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:32.984158 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dba38c27-b6b2-4a5b-957c-0b4c416e2e9e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:32.991483 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9a66fa39-5ed4-437c-9abc-05a3fc3c8524 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:32.992170 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9a66fa39-5ed4-437c-9abc-05a3fc3c8524 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:33.237384 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-9a66fa39-5ed4-437c-9abc-05a3fc3c8524 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 23211 microversion: 2.20 time: 0.312634 Nov 20 03:25:33.249148 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 98/210] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:25:32 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 23211 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:25:33.259936 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-dee47f16-c45e-489c-90f7-074d61be144f tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:33.263245 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-dee47f16-c45e-489c-90f7-074d61be144f tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:33.274856 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dee47f16-c45e-489c-90f7-074d61be144f tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:33.294995 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dee47f16-c45e-489c-90f7-074d61be144f tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:33.296023 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dee47f16-c45e-489c-90f7-074d61be144f tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:33.296475 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dee47f16-c45e-489c-90f7-074d61be144f tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:33.335146 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.wsgi [None req-dee47f16-c45e-489c-90f7-074d61be144f tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] HTTP exception thrown: Instance 459573a2-39ec-47c3-8815-297d17954f29 could not be found. Nov 20 03:25:33.337072 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-dee47f16-c45e-489c-90f7-074d61be144f tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Returning 404 to user: Instance 459573a2-39ec-47c3-8815-297d17954f29 could not be found. {{(pid=116113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:25:33.342442 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-dee47f16-c45e-489c-90f7-074d61be144f tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.090820 Nov 20 03:25:33.343472 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 99/211] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:25:33 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29/os-volume_attachments => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:25:33.468224 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-dba38c27-b6b2-4a5b-957c-0b4c416e2e9e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:33.480038 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-dba38c27-b6b2-4a5b-957c-0b4c416e2e9e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1522 microversion: 2.1 time: 0.543784 Nov 20 03:25:33.481159 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 113/212] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:32 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1522 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:33.554065 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-6c2ab400-25a0-460e-bb17-b47d018ad45a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:33.555605 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-6c2ab400-25a0-460e-bb17-b47d018ad45a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: f99425ad-063b-41de-ada4-431531d73cf9] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:33.575448 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-094ab796-8932-4776-99c5-28551953709b req-ee0c6cb7-f7d3-4e59-911c-6c55ab7daa2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f99425ad-063b-41de-ada4-431531d73cf9", "tag": "409ff6fa-0f7f-4eb4-b321-ee164178b6cd"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:33.577926 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:25:33.577926 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:25:33.601653 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6c2ab400-25a0-460e-bb17-b47d018ad45a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:33.603018 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6c2ab400-25a0-460e-bb17-b47d018ad45a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:33.612277 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6c2ab400-25a0-460e-bb17-b47d018ad45a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:33.617610 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6c2ab400-25a0-460e-bb17-b47d018ad45a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:33.626860 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-094ab796-8932-4776-99c5-28551953709b req-ee0c6cb7-f7d3-4e59-911c-6c55ab7daa2d service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:33.627229 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-094ab796-8932-4776-99c5-28551953709b req-ee0c6cb7-f7d3-4e59-911c-6c55ab7daa2d service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:33.660045 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-094ab796-8932-4776-99c5-28551953709b req-ee0c6cb7-f7d3-4e59-911c-6c55ab7daa2d service nova] Creating event network-changed:409ff6fa-0f7f-4eb4-b321-ee164178b6cd for instance f99425ad-063b-41de-ada4-431531d73cf9 on hv-cinder-81803 Nov 20 03:25:33.679814 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-094ab796-8932-4776-99c5-28551953709b req-ee0c6cb7-f7d3-4e59-911c-6c55ab7daa2d service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113857 Nov 20 03:25:33.683217 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 114/213] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:25:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:25:33.987540 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-6c2ab400-25a0-460e-bb17-b47d018ad45a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:34.002827 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-6c2ab400-25a0-460e-bb17-b47d018ad45a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9" status: 200 len: 1317 microversion: 2.1 time: 0.452961 Nov 20 03:25:34.006986 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 100/214] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:33 2021] GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9 => generated 1317 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:34.250492 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-b83e9fc4-a15f-48b8-af1b-a51a34642d68 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:34.253118 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-b83e9fc4-a15f-48b8-af1b-a51a34642d68 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:34.265682 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b83e9fc4-a15f-48b8-af1b-a51a34642d68 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:34.269129 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b83e9fc4-a15f-48b8-af1b-a51a34642d68 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:34.271341 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b83e9fc4-a15f-48b8-af1b-a51a34642d68 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:34.273421 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b83e9fc4-a15f-48b8-af1b-a51a34642d68 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:34.429116 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-b83e9fc4-a15f-48b8-af1b-a51a34642d68 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 24465 microversion: 2.20 time: 0.183145 Nov 20 03:25:34.437732 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 115/215] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:25:34 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 24465 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:25:34.500212 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-d5ad872e-72a2-4ff5-a29e-70b5bc5a35db tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:34.501558 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-d5ad872e-72a2-4ff5-a29e-70b5bc5a35db tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:34.544680 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d5ad872e-72a2-4ff5-a29e-70b5bc5a35db tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:34.545997 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d5ad872e-72a2-4ff5-a29e-70b5bc5a35db tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:34.549069 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d5ad872e-72a2-4ff5-a29e-70b5bc5a35db tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:34.552162 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d5ad872e-72a2-4ff5-a29e-70b5bc5a35db tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:34.690662 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-020f2f9a-0c1a-4719-af2d-d5eb85edadc5 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:34.691774 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-020f2f9a-0c1a-4719-af2d-d5eb85edadc5 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:34.702051 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-020f2f9a-0c1a-4719-af2d-d5eb85edadc5 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:34.702645 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-020f2f9a-0c1a-4719-af2d-d5eb85edadc5 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:34.703740 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-020f2f9a-0c1a-4719-af2d-d5eb85edadc5 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:34.704512 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-020f2f9a-0c1a-4719-af2d-d5eb85edadc5 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:34.721595 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.wsgi [None req-020f2f9a-0c1a-4719-af2d-d5eb85edadc5 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] HTTP exception thrown: Instance 459573a2-39ec-47c3-8815-297d17954f29 could not be found. Nov 20 03:25:34.723113 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-020f2f9a-0c1a-4719-af2d-d5eb85edadc5 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Returning 404 to user: Instance 459573a2-39ec-47c3-8815-297d17954f29 could not be found. {{(pid=116114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:25:34.724457 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-020f2f9a-0c1a-4719-af2d-d5eb85edadc5 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "DELETE /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 404 len: 111 microversion: 2.1 time: 0.041178 Nov 20 03:25:34.728726 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 116/216] 10.222.0.37 () {58 vars in 1238 bytes} [Sat Nov 20 03:25:34 2021] DELETE /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:25:34.759379 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-5b250f84-deec-42f1-82d6-982fe12e2236 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:34.762469 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-5b250f84-deec-42f1-82d6-982fe12e2236 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] [instance: 459573a2-39ec-47c3-8815-297d17954f29] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:34.781599 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5b250f84-deec-42f1-82d6-982fe12e2236 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:34.783231 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5b250f84-deec-42f1-82d6-982fe12e2236 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:34.785051 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5b250f84-deec-42f1-82d6-982fe12e2236 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:34.786122 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5b250f84-deec-42f1-82d6-982fe12e2236 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:34.811689 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.wsgi [None req-5b250f84-deec-42f1-82d6-982fe12e2236 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] HTTP exception thrown: Instance 459573a2-39ec-47c3-8815-297d17954f29 could not be found. Nov 20 03:25:34.812771 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-5b250f84-deec-42f1-82d6-982fe12e2236 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] Returning 404 to user: Instance 459573a2-39ec-47c3-8815-297d17954f29 could not be found. {{(pid=116114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:25:34.814526 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-5b250f84-deec-42f1-82d6-982fe12e2236 tempest-DeleteServersTestJSON-11858428 tempest-DeleteServersTestJSON-11858428-project] 10.222.0.37 "GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29" status: 404 len: 111 microversion: 2.1 time: 0.084578 Nov 20 03:25:34.819381 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 117/217] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:34 2021] GET /compute/v2.1/servers/459573a2-39ec-47c3-8815-297d17954f29 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:25:34.961486 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-d5ad872e-72a2-4ff5-a29e-70b5bc5a35db tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:34.974917 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-d5ad872e-72a2-4ff5-a29e-70b5bc5a35db tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1522 microversion: 2.1 time: 0.476418 Nov 20 03:25:34.975908 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 101/218] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:34 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1522 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:35.022682 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-607bf3b0-352d-4e2c-bb64-44bf03824c7d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:35.025581 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-607bf3b0-352d-4e2c-bb64-44bf03824c7d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: f99425ad-063b-41de-ada4-431531d73cf9] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:35.035022 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-607bf3b0-352d-4e2c-bb64-44bf03824c7d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:35.035915 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-607bf3b0-352d-4e2c-bb64-44bf03824c7d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:35.037621 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-607bf3b0-352d-4e2c-bb64-44bf03824c7d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:35.038224 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-607bf3b0-352d-4e2c-bb64-44bf03824c7d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:35.279352 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-607bf3b0-352d-4e2c-bb64-44bf03824c7d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:35.291028 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-607bf3b0-352d-4e2c-bb64-44bf03824c7d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9" status: 200 len: 1317 microversion: 2.1 time: 0.272709 Nov 20 03:25:35.293793 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 118/219] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:35 2021] GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9 => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:35.444539 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-6d536297-3ae8-4b9a-b56a-858a02566294 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:35.445869 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-6d536297-3ae8-4b9a-b56a-858a02566294 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:35.484173 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6d536297-3ae8-4b9a-b56a-858a02566294 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:35.485927 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6d536297-3ae8-4b9a-b56a-858a02566294 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:35.489185 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6d536297-3ae8-4b9a-b56a-858a02566294 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:35.491375 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6d536297-3ae8-4b9a-b56a-858a02566294 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:35.991382 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-22546fc1-79ea-4358-b41e-a1e965c0774c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:35.991978 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-22546fc1-79ea-4358-b41e-a1e965c0774c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:36.008727 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-22546fc1-79ea-4358-b41e-a1e965c0774c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:36.009927 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-22546fc1-79ea-4358-b41e-a1e965c0774c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:36.011621 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-22546fc1-79ea-4358-b41e-a1e965c0774c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:36.014702 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-22546fc1-79ea-4358-b41e-a1e965c0774c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:36.444425 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-22546fc1-79ea-4358-b41e-a1e965c0774c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:36.452678 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-22546fc1-79ea-4358-b41e-a1e965c0774c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1522 microversion: 2.1 time: 0.465060 Nov 20 03:25:36.462552 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 119/220] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:35 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1522 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:36.462552 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-6a7a49b0-6946-4340-9e4f-b9418d4520e8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:36.462552 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-6a7a49b0-6946-4340-9e4f-b9418d4520e8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: f99425ad-063b-41de-ada4-431531d73cf9] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:36.476019 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6a7a49b0-6946-4340-9e4f-b9418d4520e8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:36.481739 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6a7a49b0-6946-4340-9e4f-b9418d4520e8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:36.484226 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6a7a49b0-6946-4340-9e4f-b9418d4520e8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:36.485617 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6a7a49b0-6946-4340-9e4f-b9418d4520e8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:36.902072 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-6a7a49b0-6946-4340-9e4f-b9418d4520e8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:36.914752 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-6a7a49b0-6946-4340-9e4f-b9418d4520e8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9" status: 200 len: 1317 microversion: 2.1 time: 0.457747 Nov 20 03:25:36.929162 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 120/221] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:36 2021] GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9 => generated 1317 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:37.470272 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-ad92fbb3-7fac-4dbc-ae01-6f8795553483 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:37.471107 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-ad92fbb3-7fac-4dbc-ae01-6f8795553483 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:37.479162 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ad92fbb3-7fac-4dbc-ae01-6f8795553483 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:37.480010 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ad92fbb3-7fac-4dbc-ae01-6f8795553483 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:37.481694 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ad92fbb3-7fac-4dbc-ae01-6f8795553483 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:37.482928 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ad92fbb3-7fac-4dbc-ae01-6f8795553483 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:37.771720 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-ad92fbb3-7fac-4dbc-ae01-6f8795553483 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:37.781247 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-ad92fbb3-7fac-4dbc-ae01-6f8795553483 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1522 microversion: 2.1 time: 0.315390 Nov 20 03:25:37.784231 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 121/222] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:37 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:37.871733 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-6d536297-3ae8-4b9a-b56a-858a02566294 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 27409 microversion: 2.20 time: 2.433141 Nov 20 03:25:37.890461 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 102/223] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:25:35 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 27409 bytes in 2450 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 03:25:37.949146 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-c048422d-7891-49e6-a4a7-21de67ab835d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:37.950594 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-c048422d-7891-49e6-a4a7-21de67ab835d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: f99425ad-063b-41de-ada4-431531d73cf9] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:37.962174 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c048422d-7891-49e6-a4a7-21de67ab835d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:37.962776 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c048422d-7891-49e6-a4a7-21de67ab835d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:37.966408 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c048422d-7891-49e6-a4a7-21de67ab835d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:37.970721 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c048422d-7891-49e6-a4a7-21de67ab835d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:38.312294 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-c048422d-7891-49e6-a4a7-21de67ab835d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:38.329912 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-c048422d-7891-49e6-a4a7-21de67ab835d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9" status: 200 len: 1317 microversion: 2.1 time: 0.388072 Nov 20 03:25:38.333857 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 122/224] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:37 2021] GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9 => generated 1317 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:38.803224 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-6c0f3aed-254d-4e43-adb2-a7eb54a287be tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:38.804188 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-6c0f3aed-254d-4e43-adb2-a7eb54a287be tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:38.823156 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6c0f3aed-254d-4e43-adb2-a7eb54a287be tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:38.824711 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6c0f3aed-254d-4e43-adb2-a7eb54a287be tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:38.828060 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6c0f3aed-254d-4e43-adb2-a7eb54a287be tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:38.828903 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6c0f3aed-254d-4e43-adb2-a7eb54a287be tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:38.895046 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-0572eeaa-8ef9-4afb-864c-e51b6c5f7041 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:38.896638 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-0572eeaa-8ef9-4afb-864c-e51b6c5f7041 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:38.918706 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0572eeaa-8ef9-4afb-864c-e51b6c5f7041 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:38.920420 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0572eeaa-8ef9-4afb-864c-e51b6c5f7041 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:38.921423 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0572eeaa-8ef9-4afb-864c-e51b6c5f7041 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:38.934746 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0572eeaa-8ef9-4afb-864c-e51b6c5f7041 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:39.087364 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-0572eeaa-8ef9-4afb-864c-e51b6c5f7041 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 27594 microversion: 2.20 time: 0.195889 Nov 20 03:25:39.088271 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 123/225] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:25:38 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 27594 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:25:39.192396 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-6c0f3aed-254d-4e43-adb2-a7eb54a287be tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:39.203325 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-6c0f3aed-254d-4e43-adb2-a7eb54a287be tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1522 microversion: 2.1 time: 0.408289 Nov 20 03:25:39.203937 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 103/226] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:38 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1522 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:39.350972 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-eda7db4a-572f-4c57-835a-2a9fe4b720c6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:39.351662 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-eda7db4a-572f-4c57-835a-2a9fe4b720c6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: f99425ad-063b-41de-ada4-431531d73cf9] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:39.365921 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-eda7db4a-572f-4c57-835a-2a9fe4b720c6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:39.373183 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-eda7db4a-572f-4c57-835a-2a9fe4b720c6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:39.374169 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-eda7db4a-572f-4c57-835a-2a9fe4b720c6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:39.385313 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-eda7db4a-572f-4c57-835a-2a9fe4b720c6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:39.762423 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-eda7db4a-572f-4c57-835a-2a9fe4b720c6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:39.770995 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-eda7db4a-572f-4c57-835a-2a9fe4b720c6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9" status: 200 len: 1317 microversion: 2.1 time: 0.424458 Nov 20 03:25:39.772110 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 124/227] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:39 2021] GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9 => generated 1317 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:40.104360 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-372537f4-602b-4666-baef-72693b8176d3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:40.105344 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-372537f4-602b-4666-baef-72693b8176d3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:40.118679 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-372537f4-602b-4666-baef-72693b8176d3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:40.121346 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-372537f4-602b-4666-baef-72693b8176d3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:40.122779 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-372537f4-602b-4666-baef-72693b8176d3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:40.123217 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-372537f4-602b-4666-baef-72693b8176d3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:40.255552 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-372537f4-602b-4666-baef-72693b8176d3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 27737 microversion: 2.20 time: 0.159664 Nov 20 03:25:40.261977 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 125/228] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:25:40 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 27737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 03:25:40.264617 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-2022c6b0-7631-4c37-bb4a-b1627e411cf5 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Action: 'create', calling method: .version_select at 0x7f2dad30b280>, body: {"keypair": {"name": "tempest-TestShelveInstance-817932630"}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:40.274107 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-73076ffd-37ac-46a2-b664-1dd234bd3e6f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:40.275144 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-73076ffd-37ac-46a2-b664-1dd234bd3e6f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:40.292704 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-73076ffd-37ac-46a2-b664-1dd234bd3e6f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:40.296547 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-73076ffd-37ac-46a2-b664-1dd234bd3e6f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:40.297206 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-73076ffd-37ac-46a2-b664-1dd234bd3e6f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:40.297870 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-73076ffd-37ac-46a2-b664-1dd234bd3e6f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:40.315437 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-2022c6b0-7631-4c37-bb4a-b1627e411cf5 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Getting quotas for project 4794dc407c024daf9067e5a879ec056c. Resources: {'key_pairs'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:25:40.323811 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-2022c6b0-7631-4c37-bb4a-b1627e411cf5 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Getting quotas for user e51e38fe9c394d3fbc3e826e0d345b12 and project 4794dc407c024daf9067e5a879ec056c. Resources: {'key_pairs'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:25:40.621405 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-73076ffd-37ac-46a2-b664-1dd234bd3e6f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:40.633639 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-73076ffd-37ac-46a2-b664-1dd234bd3e6f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1522 microversion: 2.1 time: 0.369382 Nov 20 03:25:40.643993 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 126/229] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:40 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:40.667855 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-2022c6b0-7631-4c37-bb4a-b1627e411cf5 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Getting quotas for project 4794dc407c024daf9067e5a879ec056c. Resources: {'key_pairs'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:25:40.678053 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-2022c6b0-7631-4c37-bb4a-b1627e411cf5 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Getting quotas for user e51e38fe9c394d3fbc3e826e0d345b12 and project 4794dc407c024daf9067e5a879ec056c. Resources: {'key_pairs'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:25:40.712448 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-2022c6b0-7631-4c37-bb4a-b1627e411cf5 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.776486 Nov 20 03:25:40.714533 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 104/230] 10.222.0.37 () {60 vars in 1157 bytes} [Sat Nov 20 03:25:39 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:40.787171 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-7606e4e4-9571-45e5-a439-f3b62a014aa0 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:40.787958 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-7606e4e4-9571-45e5-a439-f3b62a014aa0 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: f99425ad-063b-41de-ada4-431531d73cf9] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:40.796718 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7606e4e4-9571-45e5-a439-f3b62a014aa0 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:40.797133 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7606e4e4-9571-45e5-a439-f3b62a014aa0 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:40.797938 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7606e4e4-9571-45e5-a439-f3b62a014aa0 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:40.798488 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7606e4e4-9571-45e5-a439-f3b62a014aa0 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:40.987652 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-7606e4e4-9571-45e5-a439-f3b62a014aa0 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:40.995269 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-7606e4e4-9571-45e5-a439-f3b62a014aa0 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9" status: 200 len: 1317 microversion: 2.1 time: 0.211813 Nov 20 03:25:40.995858 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 127/231] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:40 2021] GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9 => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:41.286563 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-352ffa46-2e66-4f32-aedf-dba94e717283 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:41.287504 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-352ffa46-2e66-4f32-aedf-dba94e717283 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:41.301745 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-352ffa46-2e66-4f32-aedf-dba94e717283 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:41.302206 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-352ffa46-2e66-4f32-aedf-dba94e717283 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:41.304063 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-352ffa46-2e66-4f32-aedf-dba94e717283 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:41.304660 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-352ffa46-2e66-4f32-aedf-dba94e717283 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:41.439822 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-352ffa46-2e66-4f32-aedf-dba94e717283 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 27942 microversion: 2.20 time: 0.169893 Nov 20 03:25:41.441333 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 105/232] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:25:41 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 27942 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:25:41.650717 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-9776ec0e-ec66-4630-a072-21783edb451d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:41.652114 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-9776ec0e-ec66-4630-a072-21783edb451d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:41.664473 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9776ec0e-ec66-4630-a072-21783edb451d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:41.665509 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9776ec0e-ec66-4630-a072-21783edb451d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:41.666424 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9776ec0e-ec66-4630-a072-21783edb451d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:41.666883 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9776ec0e-ec66-4630-a072-21783edb451d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:42.013562 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-a0dd1aea-5e28-4d0a-9ddc-8acb28a94866 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:42.015877 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-a0dd1aea-5e28-4d0a-9ddc-8acb28a94866 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: f99425ad-063b-41de-ada4-431531d73cf9] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:42.037904 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a0dd1aea-5e28-4d0a-9ddc-8acb28a94866 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:42.038356 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a0dd1aea-5e28-4d0a-9ddc-8acb28a94866 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:42.039168 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a0dd1aea-5e28-4d0a-9ddc-8acb28a94866 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:42.045080 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a0dd1aea-5e28-4d0a-9ddc-8acb28a94866 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:42.207580 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-9776ec0e-ec66-4630-a072-21783edb451d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:42.220284 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-9776ec0e-ec66-4630-a072-21783edb451d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1502 microversion: 2.1 time: 0.573319 Nov 20 03:25:42.255960 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 128/233] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:41 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1502 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:42.270209 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-92448e38-5c31-4fee-b795-8d742eb4c905 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:42.271061 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-92448e38-5c31-4fee-b795-8d742eb4c905 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:42.284261 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-92448e38-5c31-4fee-b795-8d742eb4c905 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:42.289075 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-92448e38-5c31-4fee-b795-8d742eb4c905 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:42.290584 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-92448e38-5c31-4fee-b795-8d742eb4c905 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:42.291240 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-92448e38-5c31-4fee-b795-8d742eb4c905 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:42.702854 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a0dd1aea-5e28-4d0a-9ddc-8acb28a94866 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:42.719724 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-a0dd1aea-5e28-4d0a-9ddc-8acb28a94866 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9" status: 200 len: 1317 microversion: 2.1 time: 0.710491 Nov 20 03:25:42.722551 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 106/234] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:42 2021] GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9 => generated 1317 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:42.736809 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-d10509c2-e572-4450-b2ff-50b40277fd97 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:42.739601 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-d10509c2-e572-4450-b2ff-50b40277fd97 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:42.774114 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d10509c2-e572-4450-b2ff-50b40277fd97 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:42.776701 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d10509c2-e572-4450-b2ff-50b40277fd97 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:42.780376 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d10509c2-e572-4450-b2ff-50b40277fd97 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:42.782599 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d10509c2-e572-4450-b2ff-50b40277fd97 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:42.798384 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-92448e38-5c31-4fee-b795-8d742eb4c905 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:42.816455 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-92448e38-5c31-4fee-b795-8d742eb4c905 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1517 microversion: 2.1 time: 0.554940 Nov 20 03:25:42.831531 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 129/235] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:42 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1517 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:42.845396 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-34918478-e058-4479-90d1-60308b694256 req-06c824eb-8333-4ae6-925c-09616bd02e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f99425ad-063b-41de-ada4-431531d73cf9", "name": "network-vif-plugged", "status": "completed", "tag": "409ff6fa-0f7f-4eb4-b321-ee164178b6cd"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:42.847344 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:25:42.847344 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:25:42.865581 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-34918478-e058-4479-90d1-60308b694256 req-06c824eb-8333-4ae6-925c-09616bd02e57 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:42.866171 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-34918478-e058-4479-90d1-60308b694256 req-06c824eb-8333-4ae6-925c-09616bd02e57 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:42.889095 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-34918478-e058-4479-90d1-60308b694256 req-06c824eb-8333-4ae6-925c-09616bd02e57 service nova] Creating event network-vif-plugged:409ff6fa-0f7f-4eb4-b321-ee164178b6cd for instance f99425ad-063b-41de-ada4-431531d73cf9 on hv-cinder-81803 Nov 20 03:25:42.894487 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-34918478-e058-4479-90d1-60308b694256 req-06c824eb-8333-4ae6-925c-09616bd02e57 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061440 Nov 20 03:25:42.895722 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 130/236] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:25:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:25:43.050146 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-d10509c2-e572-4450-b2ff-50b40277fd97 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 28236 microversion: 2.20 time: 0.325021 Nov 20 03:25:43.050146 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 107/237] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:25:42 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 28236 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:25:43.744458 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-7633165d-ba1b-4ab8-8961-808791c1a978 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:43.745410 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-7633165d-ba1b-4ab8-8961-808791c1a978 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: f99425ad-063b-41de-ada4-431531d73cf9] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:43.755319 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7633165d-ba1b-4ab8-8961-808791c1a978 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:43.758059 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7633165d-ba1b-4ab8-8961-808791c1a978 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:43.758917 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7633165d-ba1b-4ab8-8961-808791c1a978 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:43.759420 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7633165d-ba1b-4ab8-8961-808791c1a978 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:43.947525 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-7633165d-ba1b-4ab8-8961-808791c1a978 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:43.957134 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-7633165d-ba1b-4ab8-8961-808791c1a978 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9" status: 200 len: 1317 microversion: 2.1 time: 0.216711 Nov 20 03:25:43.958874 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 131/238] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:43 2021] GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:44.064776 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-652c0807-842b-427c-b343-86b853178674 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:44.065926 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-652c0807-842b-427c-b343-86b853178674 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:44.073802 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-652c0807-842b-427c-b343-86b853178674 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:44.074636 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-652c0807-842b-427c-b343-86b853178674 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:44.076124 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-652c0807-842b-427c-b343-86b853178674 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:44.076676 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-652c0807-842b-427c-b343-86b853178674 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:44.199889 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-652c0807-842b-427c-b343-86b853178674 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 28236 microversion: 2.20 time: 0.140337 Nov 20 03:25:44.206540 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 108/239] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:25:44 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 28236 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:25:44.539955 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-ec0477a7-8a45-4840-847a-d26c518cea96 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:44.541339 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-ec0477a7-8a45-4840-847a-d26c518cea96 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:44.549301 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ec0477a7-8a45-4840-847a-d26c518cea96 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:44.550050 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ec0477a7-8a45-4840-847a-d26c518cea96 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:44.551405 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ec0477a7-8a45-4840-847a-d26c518cea96 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:44.552294 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ec0477a7-8a45-4840-847a-d26c518cea96 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:44.619981 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.objects.instance [None req-ec0477a7-8a45-4840-847a-d26c518cea96 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lazy-loading 'flavor' on Instance uuid 1520eab8-d6b9-48aa-8333-5c7758310e82 {{(pid=116114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 03:25:44.886307 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-ec0477a7-8a45-4840-847a-d26c518cea96 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "POST /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/action" status: 200 len: 32 microversion: 2.1 time: 0.351325 Nov 20 03:25:44.888227 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 132/240] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:25:44 2021] POST /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/action => generated 32 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 03:25:44.904732 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-8b59cdab-a1a4-49cc-a1df-83dcd0664190 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:44.905782 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-8b59cdab-a1a4-49cc-a1df-83dcd0664190 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:44.916325 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8b59cdab-a1a4-49cc-a1df-83dcd0664190 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:44.917223 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8b59cdab-a1a4-49cc-a1df-83dcd0664190 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:44.918289 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8b59cdab-a1a4-49cc-a1df-83dcd0664190 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:44.921974 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8b59cdab-a1a4-49cc-a1df-83dcd0664190 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:44.983400 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-bb1c6890-e060-4d60-8e33-e1cea1cc0753 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:44.985034 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-bb1c6890-e060-4d60-8e33-e1cea1cc0753 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: f99425ad-063b-41de-ada4-431531d73cf9] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:45.005101 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bb1c6890-e060-4d60-8e33-e1cea1cc0753 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:45.007825 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bb1c6890-e060-4d60-8e33-e1cea1cc0753 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:45.008578 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bb1c6890-e060-4d60-8e33-e1cea1cc0753 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:45.009019 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bb1c6890-e060-4d60-8e33-e1cea1cc0753 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:45.566395 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-bb1c6890-e060-4d60-8e33-e1cea1cc0753 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:45.573873 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-bb1c6890-e060-4d60-8e33-e1cea1cc0753 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9" status: 200 len: 1317 microversion: 2.1 time: 0.595531 Nov 20 03:25:45.574476 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 133/241] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:44 2021] GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9 => generated 1317 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:45.594834 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-8b59cdab-a1a4-49cc-a1df-83dcd0664190 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:45.601408 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-9593cdf0-291f-4e11-85d0-401714b49d87 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:45.603751 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-9593cdf0-291f-4e11-85d0-401714b49d87 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:45.606388 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-8b59cdab-a1a4-49cc-a1df-83dcd0664190 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.706754 Nov 20 03:25:45.610264 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 109/242] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:44 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:45.612605 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9593cdf0-291f-4e11-85d0-401714b49d87 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:45.613429 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9593cdf0-291f-4e11-85d0-401714b49d87 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:45.614392 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9593cdf0-291f-4e11-85d0-401714b49d87 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:45.614980 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9593cdf0-291f-4e11-85d0-401714b49d87 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:45.737944 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-9593cdf0-291f-4e11-85d0-401714b49d87 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 28526 microversion: 2.20 time: 0.147954 Nov 20 03:25:45.740413 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 134/243] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:25:45 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 28526 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:25:46.596812 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-3cb7c1ff-0283-4d4e-bf33-6ba3c5984625 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:46.597853 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-3cb7c1ff-0283-4d4e-bf33-6ba3c5984625 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: f99425ad-063b-41de-ada4-431531d73cf9] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:46.607217 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3cb7c1ff-0283-4d4e-bf33-6ba3c5984625 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:46.607668 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3cb7c1ff-0283-4d4e-bf33-6ba3c5984625 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:46.608488 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3cb7c1ff-0283-4d4e-bf33-6ba3c5984625 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:46.608926 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3cb7c1ff-0283-4d4e-bf33-6ba3c5984625 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:46.632069 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-15af8c09-cd3e-4f70-85a4-c2d3450b7c14 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:46.633353 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-15af8c09-cd3e-4f70-85a4-c2d3450b7c14 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:46.644503 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-15af8c09-cd3e-4f70-85a4-c2d3450b7c14 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:46.645079 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-15af8c09-cd3e-4f70-85a4-c2d3450b7c14 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:46.645959 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-15af8c09-cd3e-4f70-85a4-c2d3450b7c14 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:46.646596 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-15af8c09-cd3e-4f70-85a4-c2d3450b7c14 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:46.894494 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-3cb7c1ff-0283-4d4e-bf33-6ba3c5984625 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:46.909572 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-3cb7c1ff-0283-4d4e-bf33-6ba3c5984625 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9" status: 200 len: 1508 microversion: 2.1 time: 0.316995 Nov 20 03:25:46.912617 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 110/244] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:46 2021] GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9 => generated 1508 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:46.918741 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-9d001e9c-a08b-43cb-8ee8-446c6af6df00 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:46.925549 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-9d001e9c-a08b-43cb-8ee8-446c6af6df00 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:46.939107 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-15af8c09-cd3e-4f70-85a4-c2d3450b7c14 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:46.940716 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9d001e9c-a08b-43cb-8ee8-446c6af6df00 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:46.941657 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9d001e9c-a08b-43cb-8ee8-446c6af6df00 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:46.943128 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9d001e9c-a08b-43cb-8ee8-446c6af6df00 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:46.943755 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9d001e9c-a08b-43cb-8ee8-446c6af6df00 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:46.948029 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-15af8c09-cd3e-4f70-85a4-c2d3450b7c14 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.319822 Nov 20 03:25:46.948599 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 135/245] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:46 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:46.962682 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-19740a5f-4b88-4fe2-9e25-2bdcd5f1a83f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89cbebf4-568f-41cb-a6d4-da9e07c3ad72"}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:46.964058 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-19740a5f-4b88-4fe2-9e25-2bdcd5f1a83f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: f99425ad-063b-41de-ada4-431531d73cf9] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:46.980642 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-19740a5f-4b88-4fe2-9e25-2bdcd5f1a83f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:46.981141 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-19740a5f-4b88-4fe2-9e25-2bdcd5f1a83f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:46.981926 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-19740a5f-4b88-4fe2-9e25-2bdcd5f1a83f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:46.982352 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-19740a5f-4b88-4fe2-9e25-2bdcd5f1a83f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:47.067938 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-9d001e9c-a08b-43cb-8ee8-446c6af6df00 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 28694 microversion: 2.20 time: 0.153589 Nov 20 03:25:47.074243 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 111/246] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:25:46 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 28694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:25:47.241137 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.wsgi [None req-19740a5f-4b88-4fe2-9e25-2bdcd5f1a83f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] HTTP exception thrown: Invalid volume: volume 89cbebf4-568f-41cb-a6d4-da9e07c3ad72 is already attached to instances: 3b039039-82f2-411a-8b2f-39e31df51f77 Nov 20 03:25:47.241973 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-19740a5f-4b88-4fe2-9e25-2bdcd5f1a83f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Returning 400 to user: Invalid volume: volume 89cbebf4-568f-41cb-a6d4-da9e07c3ad72 is already attached to instances: 3b039039-82f2-411a-8b2f-39e31df51f77 {{(pid=116114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:25:47.243173 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-19740a5f-4b88-4fe2-9e25-2bdcd5f1a83f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "POST /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.289634 Nov 20 03:25:47.244875 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 136/247] 10.222.0.37 () {60 vars in 1322 bytes} [Sat Nov 20 03:25:46 2021] POST /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9/os-volume_attachments => generated 174 bytes in 291 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 03:25:47.627930 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-f4ccb7ec-2192-4538-bac0-9d18dcc088a9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:47.629613 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f4ccb7ec-2192-4538-bac0-9d18dcc088a9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:47.638842 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f4ccb7ec-2192-4538-bac0-9d18dcc088a9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:47.639301 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f4ccb7ec-2192-4538-bac0-9d18dcc088a9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:47.640193 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f4ccb7ec-2192-4538-bac0-9d18dcc088a9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:47.641326 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f4ccb7ec-2192-4538-bac0-9d18dcc088a9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:47.775472 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.objects.instance [None req-f4ccb7ec-2192-4538-bac0-9d18dcc088a9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lazy-loading 'services' on Instance uuid 3b039039-82f2-411a-8b2f-39e31df51f77 {{(pid=116113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 03:25:47.885049 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-f4ccb7ec-2192-4538-bac0-9d18dcc088a9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "DELETE /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77/os-volume_attachments/89cbebf4-568f-41cb-a6d4-da9e07c3ad72" status: 202 len: 0 microversion: 2.1 time: 0.261167 Nov 20 03:25:47.885616 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 112/248] 10.222.0.37 () {58 vars in 1415 bytes} [Sat Nov 20 03:25:47 2021] DELETE /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77/os-volume_attachments/89cbebf4-568f-41cb-a6d4-da9e07c3ad72 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:25:47.894231 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-abe350df-b944-4afc-85ae-37e1d9f7616f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:47.896810 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-abe350df-b944-4afc-85ae-37e1d9f7616f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:47.904269 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-abe350df-b944-4afc-85ae-37e1d9f7616f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:47.904725 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-abe350df-b944-4afc-85ae-37e1d9f7616f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:47.905526 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-abe350df-b944-4afc-85ae-37e1d9f7616f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:47.906054 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-abe350df-b944-4afc-85ae-37e1d9f7616f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:47.937524 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-abe350df-b944-4afc-85ae-37e1d9f7616f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047489 Nov 20 03:25:47.938106 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 137/249] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:25:47 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:25:47.967627 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-79b8e645-2b03-4ddc-a5be-615c80e0bbaa tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:47.968347 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-79b8e645-2b03-4ddc-a5be-615c80e0bbaa tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:47.974906 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-79b8e645-2b03-4ddc-a5be-615c80e0bbaa tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:47.975350 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-79b8e645-2b03-4ddc-a5be-615c80e0bbaa tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:47.976169 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-79b8e645-2b03-4ddc-a5be-615c80e0bbaa tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:47.976603 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-79b8e645-2b03-4ddc-a5be-615c80e0bbaa tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:48.080022 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-5caf8002-bfc3-43f2-aca5-75f16aaf1b8d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:48.080939 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-5caf8002-bfc3-43f2-aca5-75f16aaf1b8d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:48.086726 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5caf8002-bfc3-43f2-aca5-75f16aaf1b8d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:48.087176 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5caf8002-bfc3-43f2-aca5-75f16aaf1b8d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:48.087990 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5caf8002-bfc3-43f2-aca5-75f16aaf1b8d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:48.088506 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5caf8002-bfc3-43f2-aca5-75f16aaf1b8d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:48.112740 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-79b8e645-2b03-4ddc-a5be-615c80e0bbaa tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:48.120160 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-79b8e645-2b03-4ddc-a5be-615c80e0bbaa tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.157412 Nov 20 03:25:48.120734 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 113/250] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:47 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:48.948885 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-55ba42fb-6e53-48fe-b183-380e1443250d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:48.949851 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-55ba42fb-6e53-48fe-b183-380e1443250d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:48.956164 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-55ba42fb-6e53-48fe-b183-380e1443250d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:48.956611 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-55ba42fb-6e53-48fe-b183-380e1443250d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:48.957380 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-55ba42fb-6e53-48fe-b183-380e1443250d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:48.957814 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-55ba42fb-6e53-48fe-b183-380e1443250d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:48.986388 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-55ba42fb-6e53-48fe-b183-380e1443250d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041224 Nov 20 03:25:48.986923 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 114/251] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:25:48 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:25:49.136794 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-d6d83665-6f0b-4a9c-aa23-966f431cd687 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:49.137434 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-d6d83665-6f0b-4a9c-aa23-966f431cd687 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:49.143383 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d6d83665-6f0b-4a9c-aa23-966f431cd687 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:49.143862 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d6d83665-6f0b-4a9c-aa23-966f431cd687 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:49.144637 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d6d83665-6f0b-4a9c-aa23-966f431cd687 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:49.145073 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d6d83665-6f0b-4a9c-aa23-966f431cd687 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:49.273506 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-d6d83665-6f0b-4a9c-aa23-966f431cd687 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:49.281485 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-d6d83665-6f0b-4a9c-aa23-966f431cd687 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.148332 Nov 20 03:25:49.282049 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 115/252] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:49 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:49.997342 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-6cbcc214-3bfa-44a7-b544-85142cc5409e tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:49.998246 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-6cbcc214-3bfa-44a7-b544-85142cc5409e tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:50.004559 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6cbcc214-3bfa-44a7-b544-85142cc5409e tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:50.005003 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6cbcc214-3bfa-44a7-b544-85142cc5409e tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:50.005764 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6cbcc214-3bfa-44a7-b544-85142cc5409e tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:50.006193 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6cbcc214-3bfa-44a7-b544-85142cc5409e tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:50.035072 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-6cbcc214-3bfa-44a7-b544-85142cc5409e tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041976 Nov 20 03:25:50.035617 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 116/253] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:25:49 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:25:50.298366 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-0983d642-e3b8-4109-8e83-94c5dc87effb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:50.298977 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-0983d642-e3b8-4109-8e83-94c5dc87effb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:50.304832 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0983d642-e3b8-4109-8e83-94c5dc87effb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:50.305283 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0983d642-e3b8-4109-8e83-94c5dc87effb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:50.306050 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0983d642-e3b8-4109-8e83-94c5dc87effb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:50.306490 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0983d642-e3b8-4109-8e83-94c5dc87effb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:50.431758 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-0983d642-e3b8-4109-8e83-94c5dc87effb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:50.439684 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-0983d642-e3b8-4109-8e83-94c5dc87effb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.144973 Nov 20 03:25:50.440282 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 117/254] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:50 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:51.047058 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-1cd03c9b-1938-446c-ba22-5c53aaa808c8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:51.047945 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-1cd03c9b-1938-446c-ba22-5c53aaa808c8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:51.054400 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1cd03c9b-1938-446c-ba22-5c53aaa808c8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:51.054890 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1cd03c9b-1938-446c-ba22-5c53aaa808c8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:51.055686 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1cd03c9b-1938-446c-ba22-5c53aaa808c8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:51.056153 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1cd03c9b-1938-446c-ba22-5c53aaa808c8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:51.084592 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-1cd03c9b-1938-446c-ba22-5c53aaa808c8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041957 Nov 20 03:25:51.085149 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 118/255] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:25:51 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:25:51.233014 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-5caf8002-bfc3-43f2-aca5-75f16aaf1b8d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 28694 microversion: 2.20 time: 3.156428 Nov 20 03:25:51.233646 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 138/256] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:25:48 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 28694 bytes in 3158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 03:25:51.456670 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-9cdb0d79-75c4-4f4b-ab07-9cc9f0952e08 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:51.457279 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-9cdb0d79-75c4-4f4b-ab07-9cc9f0952e08 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:51.463069 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9cdb0d79-75c4-4f4b-ab07-9cc9f0952e08 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:51.463521 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9cdb0d79-75c4-4f4b-ab07-9cc9f0952e08 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:51.464333 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9cdb0d79-75c4-4f4b-ab07-9cc9f0952e08 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:51.464774 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9cdb0d79-75c4-4f4b-ab07-9cc9f0952e08 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:51.610585 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9cdb0d79-75c4-4f4b-ab07-9cc9f0952e08 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:51.620908 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-9cdb0d79-75c4-4f4b-ab07-9cc9f0952e08 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.168115 Nov 20 03:25:51.622168 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 119/257] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:51 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:52.096661 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-323a9d1f-3970-484f-b1a2-44f5e380ab1b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:52.097819 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-323a9d1f-3970-484f-b1a2-44f5e380ab1b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:52.104635 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-323a9d1f-3970-484f-b1a2-44f5e380ab1b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:52.105085 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-323a9d1f-3970-484f-b1a2-44f5e380ab1b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:52.106377 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-323a9d1f-3970-484f-b1a2-44f5e380ab1b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:52.106812 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-323a9d1f-3970-484f-b1a2-44f5e380ab1b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:52.138276 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-323a9d1f-3970-484f-b1a2-44f5e380ab1b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046988 Nov 20 03:25:52.138839 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 139/258] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:25:52 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:25:52.244416 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-0278d9a4-b7fa-4d9e-8766-87c70dfeded9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:52.245525 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-0278d9a4-b7fa-4d9e-8766-87c70dfeded9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:52.252084 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0278d9a4-b7fa-4d9e-8766-87c70dfeded9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:52.252531 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0278d9a4-b7fa-4d9e-8766-87c70dfeded9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:52.253438 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0278d9a4-b7fa-4d9e-8766-87c70dfeded9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:52.253892 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0278d9a4-b7fa-4d9e-8766-87c70dfeded9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:52.386774 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-0278d9a4-b7fa-4d9e-8766-87c70dfeded9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 28694 microversion: 2.20 time: 0.145774 Nov 20 03:25:52.387457 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 120/259] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:25:52 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 28694 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:25:52.638760 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-a2e6e4fc-2273-4247-85bc-534e2f8ecfd0 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:52.639677 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-a2e6e4fc-2273-4247-85bc-534e2f8ecfd0 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:52.646037 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a2e6e4fc-2273-4247-85bc-534e2f8ecfd0 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:52.646488 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a2e6e4fc-2273-4247-85bc-534e2f8ecfd0 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:52.647270 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a2e6e4fc-2273-4247-85bc-534e2f8ecfd0 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:52.647705 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a2e6e4fc-2273-4247-85bc-534e2f8ecfd0 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:52.794313 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-a2e6e4fc-2273-4247-85bc-534e2f8ecfd0 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:52.802866 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-a2e6e4fc-2273-4247-85bc-534e2f8ecfd0 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.168272 Nov 20 03:25:52.803832 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 140/260] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:52 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:53.151183 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-694dc7e0-9efb-4c31-9d7c-8665c40b4384 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:53.152360 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-694dc7e0-9efb-4c31-9d7c-8665c40b4384 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:53.160186 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-694dc7e0-9efb-4c31-9d7c-8665c40b4384 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:53.160432 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-694dc7e0-9efb-4c31-9d7c-8665c40b4384 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:53.161114 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-694dc7e0-9efb-4c31-9d7c-8665c40b4384 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:53.161539 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-694dc7e0-9efb-4c31-9d7c-8665c40b4384 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:53.190814 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-694dc7e0-9efb-4c31-9d7c-8665c40b4384 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044192 Nov 20 03:25:53.191387 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 121/261] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:25:53 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 03:25:53.353103 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-e7eb5467-ed53-4cc5-a8b3-7cf51ef08683 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1476619402", "imageRef": "e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0", "flavorRef": "452", "networks": [{"uuid": "a1acacc5-2d91-42ad-971f-cecd3a0dc9a5"}]}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:53.398714 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-76595d88-092e-4937-9266-d6a83b848ab5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:53.399686 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-76595d88-092e-4937-9266-d6a83b848ab5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:53.406167 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-76595d88-092e-4937-9266-d6a83b848ab5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:53.406618 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-76595d88-092e-4937-9266-d6a83b848ab5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:53.407389 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-76595d88-092e-4937-9266-d6a83b848ab5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:53.407848 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-76595d88-092e-4937-9266-d6a83b848ab5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:53.530770 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-76595d88-092e-4937-9266-d6a83b848ab5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 28694 microversion: 2.20 time: 0.134816 Nov 20 03:25:53.535870 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 122/262] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:25:53 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 28694 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:25:53.820705 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-00c76d1d-8728-4065-a06b-697aabed3ca7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:53.821492 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-00c76d1d-8728-4065-a06b-697aabed3ca7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:53.830687 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-00c76d1d-8728-4065-a06b-697aabed3ca7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:53.831147 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-00c76d1d-8728-4065-a06b-697aabed3ca7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:53.832248 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-00c76d1d-8728-4065-a06b-697aabed3ca7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:53.832856 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-00c76d1d-8728-4065-a06b-697aabed3ca7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:54.025351 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-00c76d1d-8728-4065-a06b-697aabed3ca7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:54.033467 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-00c76d1d-8728-4065-a06b-697aabed3ca7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.216760 Nov 20 03:25:54.034107 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 123/263] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:53 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:54.543385 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-373a74a7-376e-4b6e-a1d5-c6c175b2b176 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:54.545193 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-373a74a7-376e-4b6e-a1d5-c6c175b2b176 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:54.551972 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-373a74a7-376e-4b6e-a1d5-c6c175b2b176 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:54.552440 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-373a74a7-376e-4b6e-a1d5-c6c175b2b176 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:54.553231 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-373a74a7-376e-4b6e-a1d5-c6c175b2b176 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:54.553672 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-373a74a7-376e-4b6e-a1d5-c6c175b2b176 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:54.674524 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-373a74a7-376e-4b6e-a1d5-c6c175b2b176 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 28694 microversion: 2.20 time: 0.135159 Nov 20 03:25:54.680200 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 124/264] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:25:54 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 28694 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:25:55.051661 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-73e2267e-19d0-4e61-9198-c8994bf07afd tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:55.052403 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-73e2267e-19d0-4e61-9198-c8994bf07afd tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:55.059738 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-73e2267e-19d0-4e61-9198-c8994bf07afd tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:55.060427 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-73e2267e-19d0-4e61-9198-c8994bf07afd tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:55.061225 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-73e2267e-19d0-4e61-9198-c8994bf07afd tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:55.061660 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-73e2267e-19d0-4e61-9198-c8994bf07afd tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:55.243866 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-73e2267e-19d0-4e61-9198-c8994bf07afd tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:55.256121 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-73e2267e-19d0-4e61-9198-c8994bf07afd tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.208477 Nov 20 03:25:55.257137 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 125/265] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:55 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:55.688690 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-f1c2a69e-b203-476c-ac13-b6c63a0c5625 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:55.689711 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f1c2a69e-b203-476c-ac13-b6c63a0c5625 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:55.695644 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f1c2a69e-b203-476c-ac13-b6c63a0c5625 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:55.696118 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f1c2a69e-b203-476c-ac13-b6c63a0c5625 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:55.696899 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f1c2a69e-b203-476c-ac13-b6c63a0c5625 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:55.697338 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f1c2a69e-b203-476c-ac13-b6c63a0c5625 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:55.804277 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-f1c2a69e-b203-476c-ac13-b6c63a0c5625 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 28694 microversion: 2.20 time: 0.121198 Nov 20 03:25:55.804936 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 126/266] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:25:55 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 28694 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 03:25:56.274904 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-b601c1c1-61bf-4cfa-8c93-912303cfc2d2 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:56.279145 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-b601c1c1-61bf-4cfa-8c93-912303cfc2d2 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:56.287429 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b601c1c1-61bf-4cfa-8c93-912303cfc2d2 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:56.288193 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b601c1c1-61bf-4cfa-8c93-912303cfc2d2 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:56.289419 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b601c1c1-61bf-4cfa-8c93-912303cfc2d2 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:56.289959 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b601c1c1-61bf-4cfa-8c93-912303cfc2d2 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:56.571843 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-b601c1c1-61bf-4cfa-8c93-912303cfc2d2 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:56.582575 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-b601c1c1-61bf-4cfa-8c93-912303cfc2d2 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.311394 Nov 20 03:25:56.593613 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 127/267] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:56 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:25:56.817422 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-8844025b-a76e-4dbc-ab90-d636c5f244f1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:56.819895 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-8844025b-a76e-4dbc-ab90-d636c5f244f1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:56.828855 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8844025b-a76e-4dbc-ab90-d636c5f244f1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:56.829659 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8844025b-a76e-4dbc-ab90-d636c5f244f1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:56.831002 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8844025b-a76e-4dbc-ab90-d636c5f244f1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:56.831947 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8844025b-a76e-4dbc-ab90-d636c5f244f1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:56.951085 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-8844025b-a76e-4dbc-ab90-d636c5f244f1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 28694 microversion: 2.20 time: 0.138177 Nov 20 03:25:56.954906 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 128/268] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:25:56 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 28694 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 03:25:57.601652 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-c5518843-b155-4cc4-b842-0aa50c98584d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:57.602961 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-c5518843-b155-4cc4-b842-0aa50c98584d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:57.611546 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c5518843-b155-4cc4-b842-0aa50c98584d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:57.612415 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c5518843-b155-4cc4-b842-0aa50c98584d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:57.614755 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c5518843-b155-4cc4-b842-0aa50c98584d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:57.615483 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c5518843-b155-4cc4-b842-0aa50c98584d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:57.926591 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-c5518843-b155-4cc4-b842-0aa50c98584d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:57.937770 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-c5518843-b155-4cc4-b842-0aa50c98584d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.340390 Nov 20 03:25:57.938366 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 129/269] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:57 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:57.965846 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ff496e42-1b99-4adb-87fc-8d449501053e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:57.967430 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ff496e42-1b99-4adb-87fc-8d449501053e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:57.974256 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ff496e42-1b99-4adb-87fc-8d449501053e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:57.975597 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ff496e42-1b99-4adb-87fc-8d449501053e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:57.976522 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ff496e42-1b99-4adb-87fc-8d449501053e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:57.977023 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ff496e42-1b99-4adb-87fc-8d449501053e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:58.102762 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ff496e42-1b99-4adb-87fc-8d449501053e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 29216 microversion: 2.20 time: 0.140721 Nov 20 03:25:58.104447 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 130/270] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:25:57 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 29216 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 03:25:58.955128 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-1aa7addf-10b0-41ea-9c47-4caf493c2b7e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:25:58.955847 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-1aa7addf-10b0-41ea-9c47-4caf493c2b7e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:58.971907 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1aa7addf-10b0-41ea-9c47-4caf493c2b7e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:58.972296 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1aa7addf-10b0-41ea-9c47-4caf493c2b7e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:58.973110 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1aa7addf-10b0-41ea-9c47-4caf493c2b7e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:58.973788 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1aa7addf-10b0-41ea-9c47-4caf493c2b7e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:59.282933 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-1aa7addf-10b0-41ea-9c47-4caf493c2b7e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:25:59.306837 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-1aa7addf-10b0-41ea-9c47-4caf493c2b7e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.355732 Nov 20 03:25:59.307699 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 131/271] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:25:58 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:25:59.312527 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-c2c61c30-e62e-4930-8830-1a2df3530e21 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:25:59.313730 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-c2c61c30-e62e-4930-8830-1a2df3530e21 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:25:59.327920 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c2c61c30-e62e-4930-8830-1a2df3530e21 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:59.328688 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c2c61c30-e62e-4930-8830-1a2df3530e21 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:59.329711 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c2c61c30-e62e-4930-8830-1a2df3530e21 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:25:59.330889 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c2c61c30-e62e-4930-8830-1a2df3530e21 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:25:59.459909 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-c2c61c30-e62e-4930-8830-1a2df3530e21 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 30239 microversion: 2.20 time: 0.150705 Nov 20 03:25:59.460953 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 132/272] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:25:59 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 30239 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:26:00.333995 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-d0ae6ba3-8587-46d4-bf0a-5e129d534aeb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:00.334683 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-d0ae6ba3-8587-46d4-bf0a-5e129d534aeb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:00.354546 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d0ae6ba3-8587-46d4-bf0a-5e129d534aeb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:00.355009 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d0ae6ba3-8587-46d4-bf0a-5e129d534aeb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:00.356410 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d0ae6ba3-8587-46d4-bf0a-5e129d534aeb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:00.372241 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d0ae6ba3-8587-46d4-bf0a-5e129d534aeb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:00.699540 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-d0ae6ba3-8587-46d4-bf0a-5e129d534aeb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:00.709165 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-d0ae6ba3-8587-46d4-bf0a-5e129d534aeb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.387522 Nov 20 03:26:00.710011 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 133/273] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:00 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:00.714603 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-fcf004e4-a992-48ee-8f8e-20fc47c50fe6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:00.716913 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-fcf004e4-a992-48ee-8f8e-20fc47c50fe6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:00.727123 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fcf004e4-a992-48ee-8f8e-20fc47c50fe6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:00.727819 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fcf004e4-a992-48ee-8f8e-20fc47c50fe6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:00.728935 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fcf004e4-a992-48ee-8f8e-20fc47c50fe6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:00.729526 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fcf004e4-a992-48ee-8f8e-20fc47c50fe6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:00.909414 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-fcf004e4-a992-48ee-8f8e-20fc47c50fe6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 31068 microversion: 2.20 time: 0.197284 Nov 20 03:26:00.910649 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 134/274] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:26:00 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 31068 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:26:01.728654 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-dfc60136-8cc7-46dc-b6c5-849d37910567 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:01.730964 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-dfc60136-8cc7-46dc-b6c5-849d37910567 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:01.751825 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dfc60136-8cc7-46dc-b6c5-849d37910567 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:01.752658 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dfc60136-8cc7-46dc-b6c5-849d37910567 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:01.754010 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dfc60136-8cc7-46dc-b6c5-849d37910567 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:01.754626 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dfc60136-8cc7-46dc-b6c5-849d37910567 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:02.009400 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-dfc60136-8cc7-46dc-b6c5-849d37910567 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:02.020311 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-dfc60136-8cc7-46dc-b6c5-849d37910567 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.297101 Nov 20 03:26:02.022471 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 135/275] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:01 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:02.032465 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-37bd4805-be1c-4294-8183-c13559394277 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:02.034045 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-37bd4805-be1c-4294-8183-c13559394277 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:02.041196 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-37bd4805-be1c-4294-8183-c13559394277 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:02.041849 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-37bd4805-be1c-4294-8183-c13559394277 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:02.042814 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-37bd4805-be1c-4294-8183-c13559394277 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:02.043345 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-37bd4805-be1c-4294-8183-c13559394277 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:02.193411 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-37bd4805-be1c-4294-8183-c13559394277 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 31685 microversion: 2.20 time: 0.167590 Nov 20 03:26:02.194805 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 136/276] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:26:02 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 31685 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:26:03.038984 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-94387af4-2d90-4f68-9044-13676c21b629 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:03.039756 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-94387af4-2d90-4f68-9044-13676c21b629 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:03.049526 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-94387af4-2d90-4f68-9044-13676c21b629 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:03.050426 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-94387af4-2d90-4f68-9044-13676c21b629 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:03.051408 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-94387af4-2d90-4f68-9044-13676c21b629 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:03.052066 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-94387af4-2d90-4f68-9044-13676c21b629 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:03.263298 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-94387af4-2d90-4f68-9044-13676c21b629 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:03.270686 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-94387af4-2d90-4f68-9044-13676c21b629 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.235756 Nov 20 03:26:03.272209 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 137/277] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:03 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:03.276801 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-2fc49b88-4d23-4fe7-b7e2-4217643a46f6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:03.277948 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-2fc49b88-4d23-4fe7-b7e2-4217643a46f6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:03.285035 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2fc49b88-4d23-4fe7-b7e2-4217643a46f6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:03.285843 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2fc49b88-4d23-4fe7-b7e2-4217643a46f6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:03.286952 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2fc49b88-4d23-4fe7-b7e2-4217643a46f6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:03.287547 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2fc49b88-4d23-4fe7-b7e2-4217643a46f6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:03.430791 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-2fc49b88-4d23-4fe7-b7e2-4217643a46f6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 32381 microversion: 2.20 time: 0.157175 Nov 20 03:26:03.431448 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 138/278] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:26:03 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 32381 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:26:04.288093 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-bca348fa-a6d9-426a-9650-9c2f4bd94f64 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:04.289502 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-bca348fa-a6d9-426a-9650-9c2f4bd94f64 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:04.299466 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bca348fa-a6d9-426a-9650-9c2f4bd94f64 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:04.300106 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bca348fa-a6d9-426a-9650-9c2f4bd94f64 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:04.301147 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bca348fa-a6d9-426a-9650-9c2f4bd94f64 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:04.301801 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bca348fa-a6d9-426a-9650-9c2f4bd94f64 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:04.465712 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-bca348fa-a6d9-426a-9650-9c2f4bd94f64 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:04.474911 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-bca348fa-a6d9-426a-9650-9c2f4bd94f64 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.190769 Nov 20 03:26:04.475776 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 139/279] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:04 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:04.481770 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-f9d87528-2a68-4b30-bcd3-a4db393dc9ba tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:04.482878 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f9d87528-2a68-4b30-bcd3-a4db393dc9ba tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:04.489513 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f9d87528-2a68-4b30-bcd3-a4db393dc9ba tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:04.490315 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f9d87528-2a68-4b30-bcd3-a4db393dc9ba tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:04.491354 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f9d87528-2a68-4b30-bcd3-a4db393dc9ba tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:04.492045 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f9d87528-2a68-4b30-bcd3-a4db393dc9ba tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:04.629159 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-f9d87528-2a68-4b30-bcd3-a4db393dc9ba tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 33172 microversion: 2.20 time: 0.151425 Nov 20 03:26:04.633584 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 140/280] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:26:04 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 33172 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:26:05.493771 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ee0d1d77-1f4b-4473-bcf8-bdb1746ae362 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:05.494575 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ee0d1d77-1f4b-4473-bcf8-bdb1746ae362 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:05.507740 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ee0d1d77-1f4b-4473-bcf8-bdb1746ae362 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:05.508694 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ee0d1d77-1f4b-4473-bcf8-bdb1746ae362 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:05.509753 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ee0d1d77-1f4b-4473-bcf8-bdb1746ae362 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:05.512337 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ee0d1d77-1f4b-4473-bcf8-bdb1746ae362 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:05.812752 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-ee0d1d77-1f4b-4473-bcf8-bdb1746ae362 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:05.826045 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ee0d1d77-1f4b-4473-bcf8-bdb1746ae362 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.336196 Nov 20 03:26:05.829069 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 141/281] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:05 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:05.834800 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-1b0efe88-95a0-4465-af59-f66a18db7713 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:05.841023 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-1b0efe88-95a0-4465-af59-f66a18db7713 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:05.853535 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1b0efe88-95a0-4465-af59-f66a18db7713 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:05.853978 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1b0efe88-95a0-4465-af59-f66a18db7713 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:05.854769 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1b0efe88-95a0-4465-af59-f66a18db7713 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:05.855269 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1b0efe88-95a0-4465-af59-f66a18db7713 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:06.013517 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-1b0efe88-95a0-4465-af59-f66a18db7713 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 34007 microversion: 2.20 time: 0.182639 Nov 20 03:26:06.020907 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 142/282] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:26:05 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 34007 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:26:06.850077 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-104b50da-de99-4b6b-8c42-3f5739be4f26 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:06.851773 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-104b50da-de99-4b6b-8c42-3f5739be4f26 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:06.860622 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-104b50da-de99-4b6b-8c42-3f5739be4f26 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:06.861329 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-104b50da-de99-4b6b-8c42-3f5739be4f26 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:06.862325 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-104b50da-de99-4b6b-8c42-3f5739be4f26 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:06.862911 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-104b50da-de99-4b6b-8c42-3f5739be4f26 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:07.100755 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-104b50da-de99-4b6b-8c42-3f5739be4f26 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:07.110256 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-104b50da-de99-4b6b-8c42-3f5739be4f26 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.267770 Nov 20 03:26:07.111045 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 143/283] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:06 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:07.122964 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-9a4b2f0f-1332-4417-b640-0367f661626c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:07.124079 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-9a4b2f0f-1332-4417-b640-0367f661626c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:07.131101 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9a4b2f0f-1332-4417-b640-0367f661626c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:07.131745 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9a4b2f0f-1332-4417-b640-0367f661626c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:07.132728 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9a4b2f0f-1332-4417-b640-0367f661626c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:07.133266 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9a4b2f0f-1332-4417-b640-0367f661626c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:07.255754 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-9a4b2f0f-1332-4417-b640-0367f661626c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 34805 microversion: 2.20 time: 0.141549 Nov 20 03:26:07.257311 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 144/284] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:26:07 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 34805 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:26:08.130789 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ee5b67f4-8d8f-45e8-bda5-20ea31f1d574 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:08.133113 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ee5b67f4-8d8f-45e8-bda5-20ea31f1d574 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:08.142927 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ee5b67f4-8d8f-45e8-bda5-20ea31f1d574 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:08.143223 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ee5b67f4-8d8f-45e8-bda5-20ea31f1d574 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:08.146883 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ee5b67f4-8d8f-45e8-bda5-20ea31f1d574 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:08.147572 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ee5b67f4-8d8f-45e8-bda5-20ea31f1d574 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:08.430135 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-ee5b67f4-8d8f-45e8-bda5-20ea31f1d574 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:08.443193 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ee5b67f4-8d8f-45e8-bda5-20ea31f1d574 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.319290 Nov 20 03:26:08.444175 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 145/285] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:08 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:08.459155 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-c5cfbcec-dac0-48e1-81eb-5e7e9e8363fa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:08.460372 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-c5cfbcec-dac0-48e1-81eb-5e7e9e8363fa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:08.473157 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c5cfbcec-dac0-48e1-81eb-5e7e9e8363fa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:08.474015 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c5cfbcec-dac0-48e1-81eb-5e7e9e8363fa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:08.474940 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c5cfbcec-dac0-48e1-81eb-5e7e9e8363fa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:08.476235 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c5cfbcec-dac0-48e1-81eb-5e7e9e8363fa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:08.637394 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-c5cfbcec-dac0-48e1-81eb-5e7e9e8363fa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 35825 microversion: 2.20 time: 0.190359 Nov 20 03:26:08.639075 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 146/286] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:26:08 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 35825 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:26:09.159701 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ac28485f-460e-48d9-9037-892894e0084c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Action: 'create', calling method: .version_select at 0x7f2dad2bc160>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2111923564"}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:09.315474 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-ac28485f-460e-48d9-9037-892894e0084c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Getting quotas for project ee28f54d912d4789b1b0abf0f0cddab5. Resources: {'key_pairs'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:26:09.319335 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-ac28485f-460e-48d9-9037-892894e0084c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Getting quotas for user 2841384d235c4869bc6c39212c34f0f9 and project ee28f54d912d4789b1b0abf0f0cddab5. Resources: {'key_pairs'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:26:09.634844 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-ac28485f-460e-48d9-9037-892894e0084c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Getting quotas for project ee28f54d912d4789b1b0abf0f0cddab5. Resources: {'key_pairs'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:26:09.638744 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-ac28485f-460e-48d9-9037-892894e0084c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Getting quotas for user 2841384d235c4869bc6c39212c34f0f9 and project ee28f54d912d4789b1b0abf0f0cddab5. Resources: {'key_pairs'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:26:09.653207 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ac28485f-460e-48d9-9037-892894e0084c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.718736 Nov 20 03:26:09.653826 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 147/287] 10.222.0.37 () {60 vars in 1157 bytes} [Sat Nov 20 03:26:08 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:09.658109 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-59e3fcfd-7489-4022-b971-b0c7ad906ea0 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:09.659275 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-59e3fcfd-7489-4022-b971-b0c7ad906ea0 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:09.664992 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-59e3fcfd-7489-4022-b971-b0c7ad906ea0 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:09.665442 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-59e3fcfd-7489-4022-b971-b0c7ad906ea0 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:09.666213 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-59e3fcfd-7489-4022-b971-b0c7ad906ea0 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:09.666643 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-59e3fcfd-7489-4022-b971-b0c7ad906ea0 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:09.816901 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-59e3fcfd-7489-4022-b971-b0c7ad906ea0 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:09.825171 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-59e3fcfd-7489-4022-b971-b0c7ad906ea0 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.170343 Nov 20 03:26:09.825738 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 148/288] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:09 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:09.830913 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-f615a6a0-bf08-4198-8a0a-694653ae0da7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:09.832285 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f615a6a0-bf08-4198-8a0a-694653ae0da7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:09.838098 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f615a6a0-bf08-4198-8a0a-694653ae0da7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:09.838651 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f615a6a0-bf08-4198-8a0a-694653ae0da7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:09.840121 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f615a6a0-bf08-4198-8a0a-694653ae0da7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:09.840561 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f615a6a0-bf08-4198-8a0a-694653ae0da7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:09.962611 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-f615a6a0-bf08-4198-8a0a-694653ae0da7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 36876 microversion: 2.20 time: 0.135319 Nov 20 03:26:09.963834 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 149/289] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:26:09 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 36876 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:26:10.847758 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ba24cc8c-deaf-49cd-bf6c-c26b30866941 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:10.851045 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ba24cc8c-deaf-49cd-bf6c-c26b30866941 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:10.859948 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ba24cc8c-deaf-49cd-bf6c-c26b30866941 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:10.860656 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ba24cc8c-deaf-49cd-bf6c-c26b30866941 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:10.861683 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ba24cc8c-deaf-49cd-bf6c-c26b30866941 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:10.862345 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ba24cc8c-deaf-49cd-bf6c-c26b30866941 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:11.030859 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-ba24cc8c-deaf-49cd-bf6c-c26b30866941 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:11.038646 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ba24cc8c-deaf-49cd-bf6c-c26b30866941 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.194988 Nov 20 03:26:11.049589 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 150/290] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:10 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:11.053448 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-f4781995-b113-447e-9962-5527f55fa84b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:11.054386 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f4781995-b113-447e-9962-5527f55fa84b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:11.061524 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f4781995-b113-447e-9962-5527f55fa84b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:11.061988 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f4781995-b113-447e-9962-5527f55fa84b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:11.064223 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f4781995-b113-447e-9962-5527f55fa84b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:11.064223 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f4781995-b113-447e-9962-5527f55fa84b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:11.187531 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-f4781995-b113-447e-9962-5527f55fa84b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 37946 microversion: 2.20 time: 0.146352 Nov 20 03:26:11.188652 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 151/291] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:26:11 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 37946 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:26:12.057481 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-b4aa9676-a712-43fc-991a-ad1c18a840a7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:12.058432 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-b4aa9676-a712-43fc-991a-ad1c18a840a7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:12.065268 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b4aa9676-a712-43fc-991a-ad1c18a840a7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:12.065716 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b4aa9676-a712-43fc-991a-ad1c18a840a7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:12.066495 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b4aa9676-a712-43fc-991a-ad1c18a840a7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:12.067156 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b4aa9676-a712-43fc-991a-ad1c18a840a7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:12.235549 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-b4aa9676-a712-43fc-991a-ad1c18a840a7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:12.243467 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-b4aa9676-a712-43fc-991a-ad1c18a840a7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.189909 Nov 20 03:26:12.244427 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 152/292] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:12 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:12.251954 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ef3e7a58-4146-49bd-9b99-97bbaad2253b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:12.253603 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ef3e7a58-4146-49bd-9b99-97bbaad2253b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:12.262367 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ef3e7a58-4146-49bd-9b99-97bbaad2253b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:12.262915 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ef3e7a58-4146-49bd-9b99-97bbaad2253b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:12.263810 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ef3e7a58-4146-49bd-9b99-97bbaad2253b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:12.264320 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ef3e7a58-4146-49bd-9b99-97bbaad2253b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:12.376186 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ef3e7a58-4146-49bd-9b99-97bbaad2253b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 38213 microversion: 2.20 time: 0.130057 Nov 20 03:26:12.376942 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 153/293] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:26:12 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 38213 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:26:13.261167 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-8dc82ca4-75d8-44f3-82a6-0a801a34c090 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:13.262021 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-8dc82ca4-75d8-44f3-82a6-0a801a34c090 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:13.268848 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8dc82ca4-75d8-44f3-82a6-0a801a34c090 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:13.269302 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8dc82ca4-75d8-44f3-82a6-0a801a34c090 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:13.270076 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8dc82ca4-75d8-44f3-82a6-0a801a34c090 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:13.270515 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8dc82ca4-75d8-44f3-82a6-0a801a34c090 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:13.419838 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-8dc82ca4-75d8-44f3-82a6-0a801a34c090 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:13.427136 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-8dc82ca4-75d8-44f3-82a6-0a801a34c090 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.169965 Nov 20 03:26:13.427704 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 154/294] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:13 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:13.432151 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-6320c716-c221-428c-a31c-7d865934e42e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:13.433762 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-6320c716-c221-428c-a31c-7d865934e42e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:13.439696 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6320c716-c221-428c-a31c-7d865934e42e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:13.440175 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6320c716-c221-428c-a31c-7d865934e42e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:13.440962 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6320c716-c221-428c-a31c-7d865934e42e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:13.441396 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6320c716-c221-428c-a31c-7d865934e42e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:13.553611 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-6320c716-c221-428c-a31c-7d865934e42e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 200 len: 38354 microversion: 2.20 time: 0.124590 Nov 20 03:26:13.554592 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 155/295] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:26:13 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 38354 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:26:13.567463 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ba3bac91-ab1f-425e-aafe-f630e416d307 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:13.568063 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ba3bac91-ab1f-425e-aafe-f630e416d307 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:13.575756 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ba3bac91-ab1f-425e-aafe-f630e416d307 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:13.576308 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ba3bac91-ab1f-425e-aafe-f630e416d307 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:13.577228 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ba3bac91-ab1f-425e-aafe-f630e416d307 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:13.577671 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ba3bac91-ab1f-425e-aafe-f630e416d307 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:13.607461 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ba3bac91-ab1f-425e-aafe-f630e416d307 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/ips" status: 200 len: 152 microversion: 2.20 time: 0.044825 Nov 20 03:26:13.608082 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 156/296] 10.222.0.37 () {60 vars in 1288 bytes} [Sat Nov 20 03:26:13 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/ips => generated 152 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 03:26:13.747758 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.network.neutron [None req-e7eb5467-ed53-4cc5-a8b3-7cf51ef08683 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] validate_networks() for [('a1acacc5-2d91-42ad-971f-cecd3a0dc9a5', None, None, None, None, None)] {{(pid=116114) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 03:26:14.271765 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-e7eb5467-ed53-4cc5-a8b3-7cf51ef08683 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Flavor limits 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 03:26:14.272247 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-e7eb5467-ed53-4cc5-a8b3-7cf51ef08683 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Image limits 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 03:26:14.272720 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-e7eb5467-ed53-4cc5-a8b3-7cf51ef08683 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Flavor pref 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 03:26:14.273129 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-e7eb5467-ed53-4cc5-a8b3-7cf51ef08683 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Image pref 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 03:26:14.273539 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-e7eb5467-ed53-4cc5-a8b3-7cf51ef08683 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 03:26:14.283252 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e7eb5467-ed53-4cc5-a8b3-7cf51ef08683 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:14.283755 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e7eb5467-ed53-4cc5-a8b3-7cf51ef08683 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:14.284686 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e7eb5467-ed53-4cc5-a8b3-7cf51ef08683 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:14.285130 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e7eb5467-ed53-4cc5-a8b3-7cf51ef08683 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:14.315930 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-e7eb5467-ed53-4cc5-a8b3-7cf51ef08683 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Getting quotas for project 0fdf6e7abf574b269f3c1459a9d58c26. Resources: {'ram', 'cores', 'instances'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:26:14.333585 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-e7eb5467-ed53-4cc5-a8b3-7cf51ef08683 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Getting quotas for user e05b767f39ea49e4aa916c818a4290e7 and project 0fdf6e7abf574b269f3c1459a9d58c26. Resources: {'ram', 'cores', 'instances'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:26:14.373175 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-e7eb5467-ed53-4cc5-a8b3-7cf51ef08683 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Going to run 1 instances... {{(pid=116114) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 03:26:14.376334 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-e7eb5467-ed53-4cc5-a8b3-7cf51ef08683 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: dcb49ce9-1111-4384-8066-f155f85972d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 03:26:14.446906 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-17871918-1833-4076-9731-ebcd81d70855 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:14.447979 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-17871918-1833-4076-9731-ebcd81d70855 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:14.465627 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-e7eb5467-ed53-4cc5-a8b3-7cf51ef08683 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 21.118672 Nov 20 03:26:14.466585 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-17871918-1833-4076-9731-ebcd81d70855 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:14.467943 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-17871918-1833-4076-9731-ebcd81d70855 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:14.470355 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-17871918-1833-4076-9731-ebcd81d70855 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:14.471621 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 141/297] 10.222.0.37 () {60 vars in 1146 bytes} [Sat Nov 20 03:25:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 21125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 03:26:14.473137 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-17871918-1833-4076-9731-ebcd81d70855 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:14.478235 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-7461219d-2baa-4bc5-aed8-506bb9390042 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:14.478848 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-7461219d-2baa-4bc5-aed8-506bb9390042 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: dcb49ce9-1111-4384-8066-f155f85972d5] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:14.577281 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-7461219d-2baa-4bc5-aed8-506bb9390042 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:14.584865 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-7461219d-2baa-4bc5-aed8-506bb9390042 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5" status: 200 len: 1218 microversion: 2.1 time: 0.110329 Nov 20 03:26:14.585870 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 142/298] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:14 2021] GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5 => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:14.728121 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-17871918-1833-4076-9731-ebcd81d70855 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:14.746370 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-17871918-1833-4076-9731-ebcd81d70855 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.304641 Nov 20 03:26:14.756275 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 157/299] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:14 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:15.602437 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-842c8b6e-6bae-4165-8de1-d0b41710adf2 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:15.603075 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-842c8b6e-6bae-4165-8de1-d0b41710adf2 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: dcb49ce9-1111-4384-8066-f155f85972d5] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:15.611244 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-842c8b6e-6bae-4165-8de1-d0b41710adf2 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:15.611244 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-842c8b6e-6bae-4165-8de1-d0b41710adf2 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:15.612065 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-842c8b6e-6bae-4165-8de1-d0b41710adf2 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:15.612555 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-842c8b6e-6bae-4165-8de1-d0b41710adf2 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:15.678997 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-842c8b6e-6bae-4165-8de1-d0b41710adf2 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:15.686237 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-842c8b6e-6bae-4165-8de1-d0b41710adf2 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5" status: 200 len: 1270 microversion: 2.1 time: 0.087714 Nov 20 03:26:15.686802 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 143/300] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:15 2021] GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5 => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:15.762754 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-437683f0-0909-4a23-b89f-ab6bc89f749b tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:15.766677 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-437683f0-0909-4a23-b89f-ab6bc89f749b tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:15.773896 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-437683f0-0909-4a23-b89f-ab6bc89f749b tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:15.774489 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-437683f0-0909-4a23-b89f-ab6bc89f749b tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:15.775357 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-437683f0-0909-4a23-b89f-ab6bc89f749b tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:15.776185 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-437683f0-0909-4a23-b89f-ab6bc89f749b tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:16.236606 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-437683f0-0909-4a23-b89f-ab6bc89f749b tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:16.250035 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-437683f0-0909-4a23-b89f-ab6bc89f749b tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.491161 Nov 20 03:26:16.251943 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 158/301] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:15 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:16.501033 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-ba846df4-0010-481c-a594-1285779ae3a5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:16.501574 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-ba846df4-0010-481c-a594-1285779ae3a5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:16.521191 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ba846df4-0010-481c-a594-1285779ae3a5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:16.521725 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ba846df4-0010-481c-a594-1285779ae3a5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:16.522544 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ba846df4-0010-481c-a594-1285779ae3a5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:16.522979 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ba846df4-0010-481c-a594-1285779ae3a5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:16.569412 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.objects.instance [None req-ba846df4-0010-481c-a594-1285779ae3a5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lazy-loading 'flavor' on Instance uuid f68eb618-c745-43db-a873-7c0700c0f11c {{(pid=116114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 03:26:16.702944 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-4c639189-eb5c-4e10-80ff-83b2d3900cff tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:16.703555 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-4c639189-eb5c-4e10-80ff-83b2d3900cff tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: dcb49ce9-1111-4384-8066-f155f85972d5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:16.709880 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4c639189-eb5c-4e10-80ff-83b2d3900cff tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:16.710327 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4c639189-eb5c-4e10-80ff-83b2d3900cff tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:16.711453 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4c639189-eb5c-4e10-80ff-83b2d3900cff tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:16.712204 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4c639189-eb5c-4e10-80ff-83b2d3900cff tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:16.783485 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-4c639189-eb5c-4e10-80ff-83b2d3900cff tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:16.790654 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-4c639189-eb5c-4e10-80ff-83b2d3900cff tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5" status: 200 len: 1276 microversion: 2.1 time: 0.091415 Nov 20 03:26:16.791224 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 159/302] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:16 2021] GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5 => generated 1276 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:17.267692 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-55f4b18b-ac68-44a8-8c37-9dd8f1f913f1 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:17.268337 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-55f4b18b-ac68-44a8-8c37-9dd8f1f913f1 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:17.274287 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-55f4b18b-ac68-44a8-8c37-9dd8f1f913f1 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:17.274979 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-55f4b18b-ac68-44a8-8c37-9dd8f1f913f1 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:17.276036 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-55f4b18b-ac68-44a8-8c37-9dd8f1f913f1 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:17.277493 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-55f4b18b-ac68-44a8-8c37-9dd8f1f913f1 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:17.575511 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-55f4b18b-ac68-44a8-8c37-9dd8f1f913f1 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:17.584049 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-55f4b18b-ac68-44a8-8c37-9dd8f1f913f1 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1503 microversion: 2.1 time: 0.319959 Nov 20 03:26:17.584783 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 160/303] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:17 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1503 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:17.600988 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-e9bfbddd-40a1-43cd-9db4-aff9dac0c0c9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8d6ca58-826c-4add-879a-da7432e24ec2"}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:17.602099 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-e9bfbddd-40a1-43cd-9db4-aff9dac0c0c9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:17.608449 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e9bfbddd-40a1-43cd-9db4-aff9dac0c0c9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:17.611826 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e9bfbddd-40a1-43cd-9db4-aff9dac0c0c9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:17.612682 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e9bfbddd-40a1-43cd-9db4-aff9dac0c0c9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:17.613228 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e9bfbddd-40a1-43cd-9db4-aff9dac0c0c9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:17.648413 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.wsgi [None req-e9bfbddd-40a1-43cd-9db4-aff9dac0c0c9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] HTTP exception thrown: Cannot 'attach_volume' instance 1520eab8-d6b9-48aa-8333-5c7758310e82 while it is in vm_state rescued Nov 20 03:26:17.649229 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-e9bfbddd-40a1-43cd-9db4-aff9dac0c0c9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Returning 409 to user: Cannot 'attach_volume' instance 1520eab8-d6b9-48aa-8333-5c7758310e82 while it is in vm_state rescued {{(pid=116113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:26:17.650151 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-e9bfbddd-40a1-43cd-9db4-aff9dac0c0c9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "POST /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.053451 Nov 20 03:26:17.652455 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 161/304] 10.222.0.37 () {60 vars in 1322 bytes} [Sat Nov 20 03:26:17 2021] POST /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments => generated 152 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 20 03:26:17.661558 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-3bd925ca-caca-433b-81a5-f643c94df905 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:17.662540 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-3bd925ca-caca-433b-81a5-f643c94df905 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:17.677789 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3bd925ca-caca-433b-81a5-f643c94df905 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:17.678575 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3bd925ca-caca-433b-81a5-f643c94df905 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:17.679874 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3bd925ca-caca-433b-81a5-f643c94df905 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:17.680719 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3bd925ca-caca-433b-81a5-f643c94df905 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:17.783523 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-3bd925ca-caca-433b-81a5-f643c94df905 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "POST /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/action" status: 202 len: 0 microversion: 2.1 time: 0.126062 Nov 20 03:26:17.785302 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 162/305] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:26:17 2021] POST /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:26:17.791722 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-cb977e77-a987-4e3d-97f8-04aaf58f2d0d req-d21cca87-8293-42b2-bcf8-263e3137a98a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcb49ce9-1111-4384-8066-f155f85972d5", "tag": "20da1bff-d668-4898-a7cd-882e011aca51"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:17.793289 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:26:17.793289 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:26:17.800507 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-cb977e77-a987-4e3d-97f8-04aaf58f2d0d req-d21cca87-8293-42b2-bcf8-263e3137a98a service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:17.800960 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-cb977e77-a987-4e3d-97f8-04aaf58f2d0d req-d21cca87-8293-42b2-bcf8-263e3137a98a service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:17.813568 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-cb977e77-a987-4e3d-97f8-04aaf58f2d0d req-d21cca87-8293-42b2-bcf8-263e3137a98a service nova] Creating event network-changed:20da1bff-d668-4898-a7cd-882e011aca51 for instance dcb49ce9-1111-4384-8066-f155f85972d5 on hv-cinder-81803 Nov 20 03:26:17.819041 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-cb977e77-a987-4e3d-97f8-04aaf58f2d0d req-d21cca87-8293-42b2-bcf8-263e3137a98a service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031977 Nov 20 03:26:17.819623 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 163/306] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:26:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:26:17.834664 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-5f51e316-11a3-43c4-acdb-6d1564552255 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:17.836749 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-5f51e316-11a3-43c4-acdb-6d1564552255 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:17.847528 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5f51e316-11a3-43c4-acdb-6d1564552255 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:17.848612 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5f51e316-11a3-43c4-acdb-6d1564552255 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:17.849643 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5f51e316-11a3-43c4-acdb-6d1564552255 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:17.850242 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5f51e316-11a3-43c4-acdb-6d1564552255 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:18.194605 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-5f51e316-11a3-43c4-acdb-6d1564552255 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:18.202569 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-5f51e316-11a3-43c4-acdb-6d1564552255 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1511 microversion: 2.1 time: 0.381571 Nov 20 03:26:18.203139 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 164/307] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:17 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1511 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:18.216419 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-4e8727a4-b67c-4626-9353-d35da74303bd tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:18.217030 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-4e8727a4-b67c-4626-9353-d35da74303bd tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: dcb49ce9-1111-4384-8066-f155f85972d5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:18.222696 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4e8727a4-b67c-4626-9353-d35da74303bd tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:18.223144 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4e8727a4-b67c-4626-9353-d35da74303bd tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:18.224327 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4e8727a4-b67c-4626-9353-d35da74303bd tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:18.224770 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4e8727a4-b67c-4626-9353-d35da74303bd tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:18.624301 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-4e8727a4-b67c-4626-9353-d35da74303bd tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:18.637818 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-4e8727a4-b67c-4626-9353-d35da74303bd tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5" status: 200 len: 1318 microversion: 2.1 time: 0.424565 Nov 20 03:26:18.638416 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 165/308] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:18 2021] GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5 => generated 1318 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:18.692798 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-ba846df4-0010-481c-a594-1285779ae3a5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 202 len: 0 microversion: 2.20 time: 2.195510 Nov 20 03:26:18.693404 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 144/309] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:26:16 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 0 bytes in 2197 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 20 03:26:18.702128 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-59cc2f32-17f0-4ad9-b56d-cbf3bb417131 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:18.702750 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-59cc2f32-17f0-4ad9-b56d-cbf3bb417131 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:18.709177 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-59cc2f32-17f0-4ad9-b56d-cbf3bb417131 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:18.709685 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-59cc2f32-17f0-4ad9-b56d-cbf3bb417131 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:18.710752 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-59cc2f32-17f0-4ad9-b56d-cbf3bb417131 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:18.711577 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-59cc2f32-17f0-4ad9-b56d-cbf3bb417131 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:18.966069 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-59cc2f32-17f0-4ad9-b56d-cbf3bb417131 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:18.975721 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-59cc2f32-17f0-4ad9-b56d-cbf3bb417131 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:18.977477 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-59cc2f32-17f0-4ad9-b56d-cbf3bb417131 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:18.978818 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-59cc2f32-17f0-4ad9-b56d-cbf3bb417131 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1724 microversion: 2.20 time: 0.280745 Nov 20 03:26:18.979592 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 166/310] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:18 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1724 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:26:19.027106 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-aa8a3bef-88d1-4bfc-bd22-cb54912f545f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-25272824", "imageRef": "e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0", "flavorRef": "452", "networks": [{"uuid": "c40b0628-5368-4b0c-8d92-64cd48b8305d"}]}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:19.221005 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-3023d8d9-9652-48fd-a514-3ceb7a44d1b7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:19.221615 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-3023d8d9-9652-48fd-a514-3ceb7a44d1b7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:19.227875 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3023d8d9-9652-48fd-a514-3ceb7a44d1b7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:19.228347 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3023d8d9-9652-48fd-a514-3ceb7a44d1b7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:19.229116 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3023d8d9-9652-48fd-a514-3ceb7a44d1b7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:19.229604 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3023d8d9-9652-48fd-a514-3ceb7a44d1b7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:19.479747 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-3023d8d9-9652-48fd-a514-3ceb7a44d1b7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:19.487084 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-3023d8d9-9652-48fd-a514-3ceb7a44d1b7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1511 microversion: 2.1 time: 0.270584 Nov 20 03:26:19.487653 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 167/311] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:19 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1511 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:19.655913 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-86c9dc8a-d408-41a6-b76f-0cc7a716c72f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:19.656680 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-86c9dc8a-d408-41a6-b76f-0cc7a716c72f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: dcb49ce9-1111-4384-8066-f155f85972d5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:19.666019 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-86c9dc8a-d408-41a6-b76f-0cc7a716c72f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:19.666472 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-86c9dc8a-d408-41a6-b76f-0cc7a716c72f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:19.667260 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-86c9dc8a-d408-41a6-b76f-0cc7a716c72f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:19.667690 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-86c9dc8a-d408-41a6-b76f-0cc7a716c72f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:19.796932 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-86c9dc8a-d408-41a6-b76f-0cc7a716c72f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:19.804194 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-86c9dc8a-d408-41a6-b76f-0cc7a716c72f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5" status: 200 len: 1318 microversion: 2.1 time: 0.152103 Nov 20 03:26:19.804759 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 168/312] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:19 2021] GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:19.999243 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-13b1fe39-3683-4c1f-bf21-43c974653758 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:19.999867 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-13b1fe39-3683-4c1f-bf21-43c974653758 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:20.006906 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-13b1fe39-3683-4c1f-bf21-43c974653758 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:20.007353 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-13b1fe39-3683-4c1f-bf21-43c974653758 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:20.008226 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-13b1fe39-3683-4c1f-bf21-43c974653758 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:20.008685 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-13b1fe39-3683-4c1f-bf21-43c974653758 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:20.139623 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-13b1fe39-3683-4c1f-bf21-43c974653758 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:20.147242 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-13b1fe39-3683-4c1f-bf21-43c974653758 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:20.148766 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-13b1fe39-3683-4c1f-bf21-43c974653758 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:20.149900 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-13b1fe39-3683-4c1f-bf21-43c974653758 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1724 microversion: 2.20 time: 0.155174 Nov 20 03:26:20.150547 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 169/313] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:19 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:26:20.504039 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-376eb753-3c9a-49d5-b1ac-96268bf01111 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:20.504650 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-376eb753-3c9a-49d5-b1ac-96268bf01111 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:20.510511 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-376eb753-3c9a-49d5-b1ac-96268bf01111 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:20.510964 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-376eb753-3c9a-49d5-b1ac-96268bf01111 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:20.511767 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-376eb753-3c9a-49d5-b1ac-96268bf01111 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:20.512234 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-376eb753-3c9a-49d5-b1ac-96268bf01111 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:20.645044 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-376eb753-3c9a-49d5-b1ac-96268bf01111 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:20.652315 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-376eb753-3c9a-49d5-b1ac-96268bf01111 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1511 microversion: 2.1 time: 0.151962 Nov 20 03:26:20.653418 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 170/314] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:20 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:20.827635 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-31ee947c-dcf3-4b2c-8629-c2f3ab463606 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:20.829684 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-31ee947c-dcf3-4b2c-8629-c2f3ab463606 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: dcb49ce9-1111-4384-8066-f155f85972d5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:20.842197 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-31ee947c-dcf3-4b2c-8629-c2f3ab463606 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:20.842888 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-31ee947c-dcf3-4b2c-8629-c2f3ab463606 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:20.843963 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-31ee947c-dcf3-4b2c-8629-c2f3ab463606 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:20.844707 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-31ee947c-dcf3-4b2c-8629-c2f3ab463606 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:20.986275 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-31ee947c-dcf3-4b2c-8629-c2f3ab463606 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:20.993801 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-31ee947c-dcf3-4b2c-8629-c2f3ab463606 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5" status: 200 len: 1318 microversion: 2.1 time: 0.176126 Nov 20 03:26:20.994372 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 171/315] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:20 2021] GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:21.168291 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-1a6ad93c-8bef-4924-850d-fb1bc9529cff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:21.168933 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-1a6ad93c-8bef-4924-850d-fb1bc9529cff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:21.175362 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1a6ad93c-8bef-4924-850d-fb1bc9529cff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:21.175843 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1a6ad93c-8bef-4924-850d-fb1bc9529cff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:21.176610 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1a6ad93c-8bef-4924-850d-fb1bc9529cff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:21.177047 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1a6ad93c-8bef-4924-850d-fb1bc9529cff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:21.307402 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-1a6ad93c-8bef-4924-850d-fb1bc9529cff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:21.315130 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-1a6ad93c-8bef-4924-850d-fb1bc9529cff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:21.316615 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-1a6ad93c-8bef-4924-850d-fb1bc9529cff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:21.317767 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-1a6ad93c-8bef-4924-850d-fb1bc9529cff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1724 microversion: 2.20 time: 0.153193 Nov 20 03:26:21.318316 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 172/316] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:21 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:26:21.668821 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ae6e3159-7d54-4c8a-b678-e18e199a5652 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:21.669429 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ae6e3159-7d54-4c8a-b678-e18e199a5652 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:21.675494 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ae6e3159-7d54-4c8a-b678-e18e199a5652 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:21.675986 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ae6e3159-7d54-4c8a-b678-e18e199a5652 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:21.676772 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ae6e3159-7d54-4c8a-b678-e18e199a5652 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:21.677208 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ae6e3159-7d54-4c8a-b678-e18e199a5652 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:21.808576 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-ae6e3159-7d54-4c8a-b678-e18e199a5652 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:21.816531 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ae6e3159-7d54-4c8a-b678-e18e199a5652 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1517 microversion: 2.1 time: 0.151359 Nov 20 03:26:21.817081 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 173/317] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:21 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:22.010879 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-deda20d8-94d6-4232-8ecf-650be53678f3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:22.011686 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-deda20d8-94d6-4232-8ecf-650be53678f3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: dcb49ce9-1111-4384-8066-f155f85972d5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:22.019050 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-deda20d8-94d6-4232-8ecf-650be53678f3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:22.019508 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-deda20d8-94d6-4232-8ecf-650be53678f3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:22.020333 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-deda20d8-94d6-4232-8ecf-650be53678f3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:22.020960 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-deda20d8-94d6-4232-8ecf-650be53678f3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:22.180667 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-deda20d8-94d6-4232-8ecf-650be53678f3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:22.188246 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-deda20d8-94d6-4232-8ecf-650be53678f3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5" status: 200 len: 1318 microversion: 2.1 time: 0.180933 Nov 20 03:26:22.188870 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 174/318] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:22 2021] GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:22.338428 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ee3b19d4-2984-4ddb-aaee-17b58f040a4c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:22.339038 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ee3b19d4-2984-4ddb-aaee-17b58f040a4c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:22.345709 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ee3b19d4-2984-4ddb-aaee-17b58f040a4c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:22.346158 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ee3b19d4-2984-4ddb-aaee-17b58f040a4c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:22.346924 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ee3b19d4-2984-4ddb-aaee-17b58f040a4c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:22.347352 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ee3b19d4-2984-4ddb-aaee-17b58f040a4c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:22.476533 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-ee3b19d4-2984-4ddb-aaee-17b58f040a4c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:22.484701 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-ee3b19d4-2984-4ddb-aaee-17b58f040a4c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:22.486254 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-ee3b19d4-2984-4ddb-aaee-17b58f040a4c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:22.487415 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ee3b19d4-2984-4ddb-aaee-17b58f040a4c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1724 microversion: 2.20 time: 0.153985 Nov 20 03:26:22.487997 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 175/319] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:22 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:26:23.206397 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-fd6b2f2a-09cb-492f-82e1-4c58d39fc117 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:23.207773 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-fd6b2f2a-09cb-492f-82e1-4c58d39fc117 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: dcb49ce9-1111-4384-8066-f155f85972d5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:23.214408 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fd6b2f2a-09cb-492f-82e1-4c58d39fc117 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:23.214858 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fd6b2f2a-09cb-492f-82e1-4c58d39fc117 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:23.216265 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fd6b2f2a-09cb-492f-82e1-4c58d39fc117 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:23.216703 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fd6b2f2a-09cb-492f-82e1-4c58d39fc117 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:23.344907 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-fd6b2f2a-09cb-492f-82e1-4c58d39fc117 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:23.352366 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-fd6b2f2a-09cb-492f-82e1-4c58d39fc117 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5" status: 200 len: 1318 microversion: 2.1 time: 0.150647 Nov 20 03:26:23.352927 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 176/320] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:23 2021] GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:23.357684 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-4e18d55d-c265-4ed8-a358-0d95304e33e3 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:23.358286 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-4e18d55d-c265-4ed8-a358-0d95304e33e3 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:23.363929 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4e18d55d-c265-4ed8-a358-0d95304e33e3 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:23.364378 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4e18d55d-c265-4ed8-a358-0d95304e33e3 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:23.365151 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4e18d55d-c265-4ed8-a358-0d95304e33e3 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:23.365604 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4e18d55d-c265-4ed8-a358-0d95304e33e3 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:23.495728 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-4e18d55d-c265-4ed8-a358-0d95304e33e3 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:23.503848 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-4e18d55d-c265-4ed8-a358-0d95304e33e3 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1517 microversion: 2.1 time: 0.149972 Nov 20 03:26:23.504410 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 177/321] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:23 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1517 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:23.508666 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-2cd23f73-0032-4d23-a3de-d447c109b225 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:23.509306 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-2cd23f73-0032-4d23-a3de-d447c109b225 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:23.515301 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2cd23f73-0032-4d23-a3de-d447c109b225 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:23.515755 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2cd23f73-0032-4d23-a3de-d447c109b225 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:23.516545 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2cd23f73-0032-4d23-a3de-d447c109b225 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:23.516978 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2cd23f73-0032-4d23-a3de-d447c109b225 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:23.649341 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-2cd23f73-0032-4d23-a3de-d447c109b225 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:23.657399 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-2cd23f73-0032-4d23-a3de-d447c109b225 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:23.658976 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-2cd23f73-0032-4d23-a3de-d447c109b225 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:23.660147 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-2cd23f73-0032-4d23-a3de-d447c109b225 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1724 microversion: 2.20 time: 0.154815 Nov 20 03:26:23.660812 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 178/322] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:23 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:26:23.665799 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-461402ad-f4ec-427e-a5ff-1c6ad1dd122c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11593169-ca31-4702-b62b-5f4fd37cb698"}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:23.667151 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-461402ad-f4ec-427e-a5ff-1c6ad1dd122c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:23.673450 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-461402ad-f4ec-427e-a5ff-1c6ad1dd122c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:23.673909 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-461402ad-f4ec-427e-a5ff-1c6ad1dd122c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:23.674704 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-461402ad-f4ec-427e-a5ff-1c6ad1dd122c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:23.675192 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-461402ad-f4ec-427e-a5ff-1c6ad1dd122c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:23.948198 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-461402ad-f4ec-427e-a5ff-1c6ad1dd122c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "POST /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285849 Nov 20 03:26:23.949181 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 179/323] 10.222.0.37 () {60 vars in 1322 bytes} [Sat Nov 20 03:26:23 2021] POST /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:26:23.957099 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-2d464eca-bcd8-49f8-b831-b14648a71ab3 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1190667917", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-817932630", "security_groups": [{"name": "tempest-secgroup-smoke-752053784"}], "networks": [{"uuid": "db158230-8664-4afc-9999-4e829d8f633b"}], "block_device_mapping_v2": [{"uuid": "b3560107-b283-4908-9d5c-f224a92da5ff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:24.094665 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.network.neutron [None req-2d464eca-bcd8-49f8-b831-b14648a71ab3 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] validate_networks() for [('db158230-8664-4afc-9999-4e829d8f633b', None, None, None, None, None)] {{(pid=116113) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 03:26:24.692231 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-2d464eca-bcd8-49f8-b831-b14648a71ab3 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Flavor limits 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 03:26:24.692792 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-2d464eca-bcd8-49f8-b831-b14648a71ab3 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Image limits 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 03:26:24.693098 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-2d464eca-bcd8-49f8-b831-b14648a71ab3 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Flavor pref 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 03:26:24.693499 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-2d464eca-bcd8-49f8-b831-b14648a71ab3 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Image pref 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 03:26:24.693902 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-2d464eca-bcd8-49f8-b831-b14648a71ab3 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 03:26:24.703176 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2d464eca-bcd8-49f8-b831-b14648a71ab3 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:24.703615 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2d464eca-bcd8-49f8-b831-b14648a71ab3 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:24.704450 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2d464eca-bcd8-49f8-b831-b14648a71ab3 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:24.704875 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2d464eca-bcd8-49f8-b831-b14648a71ab3 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:24.721746 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-2d464eca-bcd8-49f8-b831-b14648a71ab3 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Getting quotas for project 4794dc407c024daf9067e5a879ec056c. Resources: {'ram', 'cores', 'instances'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:26:24.725889 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-2d464eca-bcd8-49f8-b831-b14648a71ab3 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Getting quotas for user e51e38fe9c394d3fbc3e826e0d345b12 and project 4794dc407c024daf9067e5a879ec056c. Resources: {'ram', 'cores', 'instances'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:26:24.780015 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-2d464eca-bcd8-49f8-b831-b14648a71ab3 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Going to run 1 instances... {{(pid=116113) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 03:26:24.782521 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-2d464eca-bcd8-49f8-b831-b14648a71ab3 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b3560107-b283-4908-9d5c-f224a92da5ff',volume_size=None,volume_type=None)] {{(pid=116113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 03:26:24.909477 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-2d464eca-bcd8-49f8-b831-b14648a71ab3 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.958728 Nov 20 03:26:24.910118 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 180/324] 10.222.0.37 () {60 vars in 1146 bytes} [Sat Nov 20 03:26:23 2021] POST /compute/v2.1/servers => generated 405 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 03:26:24.914466 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-9eea23b1-0977-47df-9cdc-b7dfe35286ea req-69e8de28-1fc4-4593-9150-88ef60006fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb49ce9-1111-4384-8066-f155f85972d5", "name": "network-vif-plugged", "status": "completed", "tag": "20da1bff-d668-4898-a7cd-882e011aca51"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:24.916059 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:26:24.916059 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:26:24.923093 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-9eea23b1-0977-47df-9cdc-b7dfe35286ea req-69e8de28-1fc4-4593-9150-88ef60006fc1 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:24.923523 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-9eea23b1-0977-47df-9cdc-b7dfe35286ea req-69e8de28-1fc4-4593-9150-88ef60006fc1 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:24.935082 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-9eea23b1-0977-47df-9cdc-b7dfe35286ea req-69e8de28-1fc4-4593-9150-88ef60006fc1 service nova] Creating event network-vif-plugged:20da1bff-d668-4898-a7cd-882e011aca51 for instance dcb49ce9-1111-4384-8066-f155f85972d5 on hv-cinder-81803 Nov 20 03:26:24.941772 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-9eea23b1-0977-47df-9cdc-b7dfe35286ea req-69e8de28-1fc4-4593-9150-88ef60006fc1 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029144 Nov 20 03:26:24.941772 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 181/325] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:26:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:26:24.945804 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-c687a82e-2163-4043-8027-9f4e94bc7d2f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:24.946494 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-c687a82e-2163-4043-8027-9f4e94bc7d2f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: dcb49ce9-1111-4384-8066-f155f85972d5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:24.953180 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c687a82e-2163-4043-8027-9f4e94bc7d2f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:24.953635 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c687a82e-2163-4043-8027-9f4e94bc7d2f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:24.954413 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c687a82e-2163-4043-8027-9f4e94bc7d2f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:24.954865 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c687a82e-2163-4043-8027-9f4e94bc7d2f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:25.115690 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-c687a82e-2163-4043-8027-9f4e94bc7d2f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:25.125045 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-c687a82e-2163-4043-8027-9f4e94bc7d2f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5" status: 200 len: 1318 microversion: 2.1 time: 0.182806 Nov 20 03:26:25.132544 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 182/326] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:24 2021] GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:25.137197 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-984fc780-7aea-44bb-a6b7-4eb71089d233 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:25.137876 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-984fc780-7aea-44bb-a6b7-4eb71089d233 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:25.145242 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-984fc780-7aea-44bb-a6b7-4eb71089d233 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:25.145770 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-984fc780-7aea-44bb-a6b7-4eb71089d233 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:25.146613 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-984fc780-7aea-44bb-a6b7-4eb71089d233 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:25.147123 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-984fc780-7aea-44bb-a6b7-4eb71089d233 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:25.345961 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-984fc780-7aea-44bb-a6b7-4eb71089d233 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:25.355482 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-984fc780-7aea-44bb-a6b7-4eb71089d233 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:25.357209 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-984fc780-7aea-44bb-a6b7-4eb71089d233 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:25.359018 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-984fc780-7aea-44bb-a6b7-4eb71089d233 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1724 microversion: 2.20 time: 0.225521 Nov 20 03:26:25.359589 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 183/327] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:25 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:26:25.365107 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-f15d68f6-ed66-4bed-9c88-46f9ddf973d7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:25.365721 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f15d68f6-ed66-4bed-9c88-46f9ddf973d7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:25.371866 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f15d68f6-ed66-4bed-9c88-46f9ddf973d7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:25.372299 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f15d68f6-ed66-4bed-9c88-46f9ddf973d7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:25.373076 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f15d68f6-ed66-4bed-9c88-46f9ddf973d7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:25.373508 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f15d68f6-ed66-4bed-9c88-46f9ddf973d7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:25.430348 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-f15d68f6-ed66-4bed-9c88-46f9ddf973d7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:25.437805 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-f15d68f6-ed66-4bed-9c88-46f9ddf973d7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1138 microversion: 2.1 time: 0.076938 Nov 20 03:26:25.438426 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 184/328] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:25 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1138 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:26.143034 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-b77b68f9-1d80-4638-b081-f05c244ff4b6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:26.143034 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-b77b68f9-1d80-4638-b081-f05c244ff4b6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: dcb49ce9-1111-4384-8066-f155f85972d5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:26.149437 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b77b68f9-1d80-4638-b081-f05c244ff4b6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:26.149892 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b77b68f9-1d80-4638-b081-f05c244ff4b6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:26.150672 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b77b68f9-1d80-4638-b081-f05c244ff4b6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:26.151109 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b77b68f9-1d80-4638-b081-f05c244ff4b6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:26.291038 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-b77b68f9-1d80-4638-b081-f05c244ff4b6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:26.299837 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-b77b68f9-1d80-4638-b081-f05c244ff4b6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5" status: 200 len: 1318 microversion: 2.1 time: 0.161253 Nov 20 03:26:26.300410 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 185/329] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:26 2021] GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:26.377729 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-5c51c94d-5f28-4b1f-a2ea-87fae7fc5097 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:26.378339 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-5c51c94d-5f28-4b1f-a2ea-87fae7fc5097 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:26.384792 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5c51c94d-5f28-4b1f-a2ea-87fae7fc5097 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:26.385255 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5c51c94d-5f28-4b1f-a2ea-87fae7fc5097 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:26.386044 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5c51c94d-5f28-4b1f-a2ea-87fae7fc5097 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:26.386486 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5c51c94d-5f28-4b1f-a2ea-87fae7fc5097 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:26.547198 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-5c51c94d-5f28-4b1f-a2ea-87fae7fc5097 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:26.562690 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-5c51c94d-5f28-4b1f-a2ea-87fae7fc5097 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:26.564601 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-5c51c94d-5f28-4b1f-a2ea-87fae7fc5097 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:26.567929 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-5c51c94d-5f28-4b1f-a2ea-87fae7fc5097 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1724 microversion: 2.20 time: 0.193754 Nov 20 03:26:26.568958 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 186/330] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:26 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:26:26.573518 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-0bddbc7b-d1a8-4508-b217-efbc9a09deaf tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:26.574123 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-0bddbc7b-d1a8-4508-b217-efbc9a09deaf tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:26.581238 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0bddbc7b-d1a8-4508-b217-efbc9a09deaf tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:26.581455 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0bddbc7b-d1a8-4508-b217-efbc9a09deaf tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:26.582411 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0bddbc7b-d1a8-4508-b217-efbc9a09deaf tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:26.582777 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0bddbc7b-d1a8-4508-b217-efbc9a09deaf tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:26.664789 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-0bddbc7b-d1a8-4508-b217-efbc9a09deaf tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:26.672962 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-0bddbc7b-d1a8-4508-b217-efbc9a09deaf tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1204 microversion: 2.1 time: 0.102713 Nov 20 03:26:26.673538 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 187/331] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:26 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1204 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:27.317629 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-a5f4ef26-eb8d-4bd3-8606-4b3551cbe122 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:27.318441 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-a5f4ef26-eb8d-4bd3-8606-4b3551cbe122 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: dcb49ce9-1111-4384-8066-f155f85972d5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:27.326787 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a5f4ef26-eb8d-4bd3-8606-4b3551cbe122 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:27.327311 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a5f4ef26-eb8d-4bd3-8606-4b3551cbe122 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:27.328205 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a5f4ef26-eb8d-4bd3-8606-4b3551cbe122 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:27.328711 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a5f4ef26-eb8d-4bd3-8606-4b3551cbe122 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:27.546350 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a5f4ef26-eb8d-4bd3-8606-4b3551cbe122 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:27.555495 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-a5f4ef26-eb8d-4bd3-8606-4b3551cbe122 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5" status: 200 len: 1509 microversion: 2.1 time: 0.241811 Nov 20 03:26:27.556350 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 188/332] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:27 2021] GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5 => generated 1509 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:27.587420 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-a372c961-3b61-4281-88ab-50f87000baca tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:27.588303 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-a372c961-3b61-4281-88ab-50f87000baca tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:27.597432 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a372c961-3b61-4281-88ab-50f87000baca tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:27.597877 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a372c961-3b61-4281-88ab-50f87000baca tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:27.599117 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a372c961-3b61-4281-88ab-50f87000baca tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:27.599547 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a372c961-3b61-4281-88ab-50f87000baca tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:27.859163 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a372c961-3b61-4281-88ab-50f87000baca tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:27.869610 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a372c961-3b61-4281-88ab-50f87000baca tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:27.871712 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a372c961-3b61-4281-88ab-50f87000baca tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:27.872902 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-a372c961-3b61-4281-88ab-50f87000baca tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1724 microversion: 2.20 time: 0.289073 Nov 20 03:26:27.873827 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 189/333] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:27 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:26:27.878158 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-1ce30ecf-2d2a-4e04-9076-1d0b259fab2d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:27.878970 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-1ce30ecf-2d2a-4e04-9076-1d0b259fab2d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:27.884738 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1ce30ecf-2d2a-4e04-9076-1d0b259fab2d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:27.885178 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1ce30ecf-2d2a-4e04-9076-1d0b259fab2d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:27.885942 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1ce30ecf-2d2a-4e04-9076-1d0b259fab2d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:27.886371 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1ce30ecf-2d2a-4e04-9076-1d0b259fab2d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:28.133877 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-1ce30ecf-2d2a-4e04-9076-1d0b259fab2d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:28.145751 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-1ce30ecf-2d2a-4e04-9076-1d0b259fab2d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1271 microversion: 2.1 time: 0.270706 Nov 20 03:26:28.146331 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 190/334] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:27 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1271 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:28.305682 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-2a0bf29c-064a-4a26-b635-da4c0b46b49b req-938619a2-d342-4a9b-99d6-526bd7dca0cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd", "tag": "c4f59d4b-9c47-44dc-ae92-832b37f470bd"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:28.307759 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:26:28.307759 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:26:28.315428 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-2a0bf29c-064a-4a26-b635-da4c0b46b49b req-938619a2-d342-4a9b-99d6-526bd7dca0cc service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:28.315910 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-2a0bf29c-064a-4a26-b635-da4c0b46b49b req-938619a2-d342-4a9b-99d6-526bd7dca0cc service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:28.333558 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-2a0bf29c-064a-4a26-b635-da4c0b46b49b req-938619a2-d342-4a9b-99d6-526bd7dca0cc service nova] Creating event network-changed:c4f59d4b-9c47-44dc-ae92-832b37f470bd for instance 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd on hv-cinder-81803 Nov 20 03:26:28.338510 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-2a0bf29c-064a-4a26-b635-da4c0b46b49b req-938619a2-d342-4a9b-99d6-526bd7dca0cc service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036683 Nov 20 03:26:28.339205 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 191/335] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:26:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:26:28.892690 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-dd9d1112-c158-4b25-b25f-69140274e51c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:28.894061 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-dd9d1112-c158-4b25-b25f-69140274e51c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:28.899947 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dd9d1112-c158-4b25-b25f-69140274e51c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:28.901144 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dd9d1112-c158-4b25-b25f-69140274e51c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:28.902004 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dd9d1112-c158-4b25-b25f-69140274e51c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:28.903327 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dd9d1112-c158-4b25-b25f-69140274e51c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:29.149623 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-dd9d1112-c158-4b25-b25f-69140274e51c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:29.158453 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-dd9d1112-c158-4b25-b25f-69140274e51c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:29.160007 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-dd9d1112-c158-4b25-b25f-69140274e51c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:29.161157 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-dd9d1112-c158-4b25-b25f-69140274e51c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1724 microversion: 2.20 time: 0.272887 Nov 20 03:26:29.161711 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 192/336] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:28 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:26:29.169643 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-f2b329c8-50b5-42f5-9f65-d899b99fceee tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e62af150-6ab2-4ce8-92cc-0916f5f2465a"}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:29.169643 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f2b329c8-50b5-42f5-9f65-d899b99fceee tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: dcb49ce9-1111-4384-8066-f155f85972d5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:29.176793 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f2b329c8-50b5-42f5-9f65-d899b99fceee tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:29.177245 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f2b329c8-50b5-42f5-9f65-d899b99fceee tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:29.178036 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f2b329c8-50b5-42f5-9f65-d899b99fceee tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:29.178467 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f2b329c8-50b5-42f5-9f65-d899b99fceee tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:29.505308 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-f2b329c8-50b5-42f5-9f65-d899b99fceee tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "POST /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.342409 Nov 20 03:26:29.506626 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 193/337] 10.222.0.37 () {60 vars in 1322 bytes} [Sat Nov 20 03:26:29 2021] POST /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:26:29.511639 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-249d9c52-d813-4eca-9b1f-e5fe5033ebfb tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:29.514016 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-249d9c52-d813-4eca-9b1f-e5fe5033ebfb tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:29.521561 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-249d9c52-d813-4eca-9b1f-e5fe5033ebfb tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:29.522766 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-249d9c52-d813-4eca-9b1f-e5fe5033ebfb tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:29.523935 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-249d9c52-d813-4eca-9b1f-e5fe5033ebfb tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:29.524560 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-249d9c52-d813-4eca-9b1f-e5fe5033ebfb tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:29.731491 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-249d9c52-d813-4eca-9b1f-e5fe5033ebfb tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:29.740602 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-249d9c52-d813-4eca-9b1f-e5fe5033ebfb tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1271 microversion: 2.1 time: 0.232599 Nov 20 03:26:29.741385 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 194/338] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:29 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1271 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:30.179479 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-2ec40741-1af1-4b8e-8722-015b64f7caff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:30.180216 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-2ec40741-1af1-4b8e-8722-015b64f7caff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:30.187923 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2ec40741-1af1-4b8e-8722-015b64f7caff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:30.188416 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2ec40741-1af1-4b8e-8722-015b64f7caff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:30.189209 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2ec40741-1af1-4b8e-8722-015b64f7caff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:30.189923 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2ec40741-1af1-4b8e-8722-015b64f7caff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:30.328119 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-2ec40741-1af1-4b8e-8722-015b64f7caff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:30.336287 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-2ec40741-1af1-4b8e-8722-015b64f7caff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:30.337805 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-2ec40741-1af1-4b8e-8722-015b64f7caff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:30.338967 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-2ec40741-1af1-4b8e-8722-015b64f7caff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1724 microversion: 2.20 time: 0.163243 Nov 20 03:26:30.339977 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 195/339] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:30 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:26:30.757615 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ee6597ed-1a82-4126-b327-57b89fe9f200 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:30.758408 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ee6597ed-1a82-4126-b327-57b89fe9f200 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:30.764934 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ee6597ed-1a82-4126-b327-57b89fe9f200 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:30.765391 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ee6597ed-1a82-4126-b327-57b89fe9f200 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:30.766181 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ee6597ed-1a82-4126-b327-57b89fe9f200 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:30.766621 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ee6597ed-1a82-4126-b327-57b89fe9f200 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:30.898884 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-ee6597ed-1a82-4126-b327-57b89fe9f200 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:30.909428 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ee6597ed-1a82-4126-b327-57b89fe9f200 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1271 microversion: 2.1 time: 0.155278 Nov 20 03:26:30.910021 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 196/340] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:30 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:31.358748 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-f8134807-560d-43c1-9a4f-e5057457d512 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:31.359403 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f8134807-560d-43c1-9a4f-e5057457d512 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:31.365420 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f8134807-560d-43c1-9a4f-e5057457d512 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:31.365874 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f8134807-560d-43c1-9a4f-e5057457d512 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:31.366674 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f8134807-560d-43c1-9a4f-e5057457d512 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:31.367110 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f8134807-560d-43c1-9a4f-e5057457d512 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:31.500221 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-f8134807-560d-43c1-9a4f-e5057457d512 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:31.508003 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-f8134807-560d-43c1-9a4f-e5057457d512 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:31.509532 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-f8134807-560d-43c1-9a4f-e5057457d512 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:31.510674 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-f8134807-560d-43c1-9a4f-e5057457d512 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1724 microversion: 2.20 time: 0.156258 Nov 20 03:26:31.511225 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 197/341] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:31 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:26:31.515807 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-2a0b7547-e4c7-47d8-b765-4de07264b4fb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:31.516810 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-2a0b7547-e4c7-47d8-b765-4de07264b4fb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:31.522158 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2a0b7547-e4c7-47d8-b765-4de07264b4fb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:31.522611 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2a0b7547-e4c7-47d8-b765-4de07264b4fb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:31.523387 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2a0b7547-e4c7-47d8-b765-4de07264b4fb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:31.523858 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2a0b7547-e4c7-47d8-b765-4de07264b4fb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:31.551511 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.objects.instance [None req-2a0b7547-e4c7-47d8-b765-4de07264b4fb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lazy-loading 'flavor' on Instance uuid 1520eab8-d6b9-48aa-8333-5c7758310e82 {{(pid=116113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 03:26:31.674518 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-2a0b7547-e4c7-47d8-b765-4de07264b4fb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "POST /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/action" status: 200 len: 32 microversion: 2.1 time: 0.161975 Nov 20 03:26:31.675194 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 198/342] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:26:31 2021] POST /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/action => generated 32 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 03:26:31.684356 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-094592d4-0052-4c8c-b999-7467ef6946d7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:31.685061 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-094592d4-0052-4c8c-b999-7467ef6946d7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:31.691150 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-094592d4-0052-4c8c-b999-7467ef6946d7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:31.691611 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-094592d4-0052-4c8c-b999-7467ef6946d7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:31.692564 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-094592d4-0052-4c8c-b999-7467ef6946d7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:31.692906 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-094592d4-0052-4c8c-b999-7467ef6946d7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:31.908504 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-094592d4-0052-4c8c-b999-7467ef6946d7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:31.919514 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-094592d4-0052-4c8c-b999-7467ef6946d7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1569 microversion: 2.1 time: 0.238457 Nov 20 03:26:31.931037 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 199/343] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:31 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1569 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:31.936333 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-f9c20059-4dea-49af-8d16-9e2e6b25230d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:31.937066 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f9c20059-4dea-49af-8d16-9e2e6b25230d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:31.943943 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f9c20059-4dea-49af-8d16-9e2e6b25230d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:31.944584 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f9c20059-4dea-49af-8d16-9e2e6b25230d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:31.945819 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f9c20059-4dea-49af-8d16-9e2e6b25230d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:31.946360 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f9c20059-4dea-49af-8d16-9e2e6b25230d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:32.416030 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-f9c20059-4dea-49af-8d16-9e2e6b25230d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:32.423427 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-f9c20059-4dea-49af-8d16-9e2e6b25230d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1271 microversion: 2.1 time: 0.491092 Nov 20 03:26:32.424025 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 200/344] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:31 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1271 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:32.529399 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-46591238-fa37-4894-8f55-6ac382f2b667 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:32.530017 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-46591238-fa37-4894-8f55-6ac382f2b667 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:32.536070 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-46591238-fa37-4894-8f55-6ac382f2b667 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:32.536528 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-46591238-fa37-4894-8f55-6ac382f2b667 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:32.537319 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-46591238-fa37-4894-8f55-6ac382f2b667 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:32.537758 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-46591238-fa37-4894-8f55-6ac382f2b667 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:32.674882 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-46591238-fa37-4894-8f55-6ac382f2b667 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:32.683164 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-46591238-fa37-4894-8f55-6ac382f2b667 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:32.685213 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-46591238-fa37-4894-8f55-6ac382f2b667 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:32.686355 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-46591238-fa37-4894-8f55-6ac382f2b667 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1724 microversion: 2.20 time: 0.160890 Nov 20 03:26:32.687177 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 201/345] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:32 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:26:32.937802 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-bae24807-5928-4b51-bcd3-c18a8ac744a8 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:32.938418 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-bae24807-5928-4b51-bcd3-c18a8ac744a8 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:32.944640 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bae24807-5928-4b51-bcd3-c18a8ac744a8 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:32.945091 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bae24807-5928-4b51-bcd3-c18a8ac744a8 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:32.945859 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bae24807-5928-4b51-bcd3-c18a8ac744a8 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:32.946296 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bae24807-5928-4b51-bcd3-c18a8ac744a8 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:33.082506 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-bae24807-5928-4b51-bcd3-c18a8ac744a8 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:33.091283 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-bae24807-5928-4b51-bcd3-c18a8ac744a8 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1569 microversion: 2.1 time: 0.157675 Nov 20 03:26:33.091889 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 202/346] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:32 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:33.440036 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-400d6852-ec50-46e1-bad8-40668546a94e tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:33.440671 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-400d6852-ec50-46e1-bad8-40668546a94e tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:33.446661 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-400d6852-ec50-46e1-bad8-40668546a94e tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:33.447103 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-400d6852-ec50-46e1-bad8-40668546a94e tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:33.447903 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-400d6852-ec50-46e1-bad8-40668546a94e tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:33.448337 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-400d6852-ec50-46e1-bad8-40668546a94e tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:33.582811 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-400d6852-ec50-46e1-bad8-40668546a94e tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:33.591686 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-400d6852-ec50-46e1-bad8-40668546a94e tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1259 microversion: 2.1 time: 0.154604 Nov 20 03:26:33.592299 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 203/347] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:33 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:33.704716 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-1b0ec916-7adc-48e9-8b21-49df8a8fd45d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:33.705189 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-1b0ec916-7adc-48e9-8b21-49df8a8fd45d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:33.711292 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1b0ec916-7adc-48e9-8b21-49df8a8fd45d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:33.711712 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1b0ec916-7adc-48e9-8b21-49df8a8fd45d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:33.712535 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1b0ec916-7adc-48e9-8b21-49df8a8fd45d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:33.712973 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1b0ec916-7adc-48e9-8b21-49df8a8fd45d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:33.847709 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-1b0ec916-7adc-48e9-8b21-49df8a8fd45d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:33.856093 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-1b0ec916-7adc-48e9-8b21-49df8a8fd45d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:33.858297 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-1b0ec916-7adc-48e9-8b21-49df8a8fd45d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:33.859451 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-1b0ec916-7adc-48e9-8b21-49df8a8fd45d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1724 microversion: 2.20 time: 0.158552 Nov 20 03:26:33.860036 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 204/348] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:33 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:26:34.109404 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-6a27f62f-b372-4028-b063-09cb509b360a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:34.110042 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-6a27f62f-b372-4028-b063-09cb509b360a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:34.116748 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6a27f62f-b372-4028-b063-09cb509b360a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:34.117201 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6a27f62f-b372-4028-b063-09cb509b360a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:34.118019 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6a27f62f-b372-4028-b063-09cb509b360a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:34.118460 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6a27f62f-b372-4028-b063-09cb509b360a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:34.248673 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-6a27f62f-b372-4028-b063-09cb509b360a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:34.256325 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-6a27f62f-b372-4028-b063-09cb509b360a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1569 microversion: 2.1 time: 0.151833 Nov 20 03:26:34.256894 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 205/349] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:34 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:34.607965 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-9f5bf1f5-b47e-4a27-970e-4b28aeb99956 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:34.608573 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-9f5bf1f5-b47e-4a27-970e-4b28aeb99956 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:34.614310 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9f5bf1f5-b47e-4a27-970e-4b28aeb99956 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:34.614768 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9f5bf1f5-b47e-4a27-970e-4b28aeb99956 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:34.615579 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9f5bf1f5-b47e-4a27-970e-4b28aeb99956 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:34.616183 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9f5bf1f5-b47e-4a27-970e-4b28aeb99956 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:34.752136 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9f5bf1f5-b47e-4a27-970e-4b28aeb99956 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:34.759571 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-9f5bf1f5-b47e-4a27-970e-4b28aeb99956 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1259 microversion: 2.1 time: 0.155359 Nov 20 03:26:34.760181 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 206/350] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:34 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:34.877929 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-cc66a8a5-20d4-4899-885b-e21ae5872802 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:34.878565 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-cc66a8a5-20d4-4899-885b-e21ae5872802 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:34.884500 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cc66a8a5-20d4-4899-885b-e21ae5872802 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:34.884951 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cc66a8a5-20d4-4899-885b-e21ae5872802 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:34.885724 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cc66a8a5-20d4-4899-885b-e21ae5872802 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:34.886162 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cc66a8a5-20d4-4899-885b-e21ae5872802 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:35.021662 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-cc66a8a5-20d4-4899-885b-e21ae5872802 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:35.029963 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-cc66a8a5-20d4-4899-885b-e21ae5872802 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:35.031474 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-cc66a8a5-20d4-4899-885b-e21ae5872802 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:35.032677 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-cc66a8a5-20d4-4899-885b-e21ae5872802 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1745 microversion: 2.20 time: 0.158456 Nov 20 03:26:35.033245 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 207/351] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:34 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:26:35.274191 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-80f53df6-5ecf-4c65-9149-9141c16dbb40 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:35.274795 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-80f53df6-5ecf-4c65-9149-9141c16dbb40 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:35.281692 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-80f53df6-5ecf-4c65-9149-9141c16dbb40 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:35.282147 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-80f53df6-5ecf-4c65-9149-9141c16dbb40 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:35.282924 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-80f53df6-5ecf-4c65-9149-9141c16dbb40 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:35.283365 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-80f53df6-5ecf-4c65-9149-9141c16dbb40 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:35.413669 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-80f53df6-5ecf-4c65-9149-9141c16dbb40 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:35.421411 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-80f53df6-5ecf-4c65-9149-9141c16dbb40 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1569 microversion: 2.1 time: 0.150991 Nov 20 03:26:35.421970 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 208/352] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:35 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:35.776704 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-c4028ce6-154f-4de4-9a8a-4f06c0e50363 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:35.777310 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-c4028ce6-154f-4de4-9a8a-4f06c0e50363 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:35.783255 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c4028ce6-154f-4de4-9a8a-4f06c0e50363 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:35.783699 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c4028ce6-154f-4de4-9a8a-4f06c0e50363 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:35.784491 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c4028ce6-154f-4de4-9a8a-4f06c0e50363 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:35.784923 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c4028ce6-154f-4de4-9a8a-4f06c0e50363 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:35.920462 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-c4028ce6-154f-4de4-9a8a-4f06c0e50363 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:35.927976 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-c4028ce6-154f-4de4-9a8a-4f06c0e50363 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1259 microversion: 2.1 time: 0.154810 Nov 20 03:26:35.928561 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 209/353] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:35 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:36.050969 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-011b3729-2f85-4561-a431-8a6f6a0db25f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:36.051772 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-011b3729-2f85-4561-a431-8a6f6a0db25f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:36.057627 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-011b3729-2f85-4561-a431-8a6f6a0db25f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:36.058149 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-011b3729-2f85-4561-a431-8a6f6a0db25f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:36.058994 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-011b3729-2f85-4561-a431-8a6f6a0db25f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:36.059531 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-011b3729-2f85-4561-a431-8a6f6a0db25f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:36.192362 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-011b3729-2f85-4561-a431-8a6f6a0db25f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:36.200146 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-011b3729-2f85-4561-a431-8a6f6a0db25f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:36.201621 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-011b3729-2f85-4561-a431-8a6f6a0db25f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:36.202757 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-011b3729-2f85-4561-a431-8a6f6a0db25f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1745 microversion: 2.20 time: 0.155583 Nov 20 03:26:36.203304 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 210/354] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:36 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:26:36.439008 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-1e3b1e45-eb9e-49d7-9b99-3794de7113c3 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:36.439619 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-1e3b1e45-eb9e-49d7-9b99-3794de7113c3 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:36.445783 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1e3b1e45-eb9e-49d7-9b99-3794de7113c3 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:36.446236 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1e3b1e45-eb9e-49d7-9b99-3794de7113c3 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:36.447026 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1e3b1e45-eb9e-49d7-9b99-3794de7113c3 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:36.447471 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1e3b1e45-eb9e-49d7-9b99-3794de7113c3 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:36.594847 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-1e3b1e45-eb9e-49d7-9b99-3794de7113c3 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:36.603541 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-1e3b1e45-eb9e-49d7-9b99-3794de7113c3 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1569 microversion: 2.1 time: 0.168849 Nov 20 03:26:36.604149 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 211/355] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:36 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:36.945264 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-96dd4f09-d62b-4b79-9afd-d05eb9d805c4 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:36.945975 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-96dd4f09-d62b-4b79-9afd-d05eb9d805c4 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:36.955144 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-96dd4f09-d62b-4b79-9afd-d05eb9d805c4 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:36.955592 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-96dd4f09-d62b-4b79-9afd-d05eb9d805c4 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:36.956469 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-96dd4f09-d62b-4b79-9afd-d05eb9d805c4 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:36.957227 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-96dd4f09-d62b-4b79-9afd-d05eb9d805c4 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:37.089118 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-96dd4f09-d62b-4b79-9afd-d05eb9d805c4 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:37.096600 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-96dd4f09-d62b-4b79-9afd-d05eb9d805c4 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1259 microversion: 2.1 time: 0.154935 Nov 20 03:26:37.097168 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 212/356] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:36 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:37.220694 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-4d0f1bfe-022b-4f57-97cb-987828012134 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:37.221300 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-4d0f1bfe-022b-4f57-97cb-987828012134 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:37.227631 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4d0f1bfe-022b-4f57-97cb-987828012134 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:37.228118 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4d0f1bfe-022b-4f57-97cb-987828012134 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:37.228906 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4d0f1bfe-022b-4f57-97cb-987828012134 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:37.229342 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4d0f1bfe-022b-4f57-97cb-987828012134 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:37.357890 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-4d0f1bfe-022b-4f57-97cb-987828012134 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:37.365616 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-4d0f1bfe-022b-4f57-97cb-987828012134 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:37.367126 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-4d0f1bfe-022b-4f57-97cb-987828012134 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:37.368368 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-4d0f1bfe-022b-4f57-97cb-987828012134 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1745 microversion: 2.20 time: 0.151351 Nov 20 03:26:37.368929 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 213/357] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:37 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:26:37.620566 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-1e9b60c8-fe70-47cd-9361-658b9c0d8c71 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:37.621180 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-1e9b60c8-fe70-47cd-9361-658b9c0d8c71 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:37.627483 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1e9b60c8-fe70-47cd-9361-658b9c0d8c71 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:37.627969 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1e9b60c8-fe70-47cd-9361-658b9c0d8c71 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:37.628748 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1e9b60c8-fe70-47cd-9361-658b9c0d8c71 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:37.629216 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1e9b60c8-fe70-47cd-9361-658b9c0d8c71 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:37.765760 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-1e9b60c8-fe70-47cd-9361-658b9c0d8c71 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:37.773582 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-1e9b60c8-fe70-47cd-9361-658b9c0d8c71 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1569 microversion: 2.1 time: 0.156677 Nov 20 03:26:37.774145 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 214/358] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:37 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:38.114046 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-a92f7e4e-e73b-4e75-ab1b-80fadfffe8ae tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:38.114654 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-a92f7e4e-e73b-4e75-ab1b-80fadfffe8ae tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:38.120457 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a92f7e4e-e73b-4e75-ab1b-80fadfffe8ae tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:38.120911 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a92f7e4e-e73b-4e75-ab1b-80fadfffe8ae tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:38.121689 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a92f7e4e-e73b-4e75-ab1b-80fadfffe8ae tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:38.122125 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a92f7e4e-e73b-4e75-ab1b-80fadfffe8ae tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:38.258761 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a92f7e4e-e73b-4e75-ab1b-80fadfffe8ae tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:38.266561 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-a92f7e4e-e73b-4e75-ab1b-80fadfffe8ae tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1259 microversion: 2.1 time: 0.156721 Nov 20 03:26:38.267125 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 215/359] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:38 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:38.271523 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-6ad38bbc-2d43-4632-8357-ec4c0152f8c8 req-af4d6072-5bfc-48cb-b013-0d3c0a6cc7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f68eb618-c745-43db-a873-7c0700c0f11c", "name": "network-vif-plugged", "status": "completed", "tag": "7a19e0fe-867b-45fc-9ef7-f883f1a8dbd9"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:38.273172 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:26:38.273172 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:26:38.280172 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-6ad38bbc-2d43-4632-8357-ec4c0152f8c8 req-af4d6072-5bfc-48cb-b013-0d3c0a6cc7f5 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:38.280549 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-6ad38bbc-2d43-4632-8357-ec4c0152f8c8 req-af4d6072-5bfc-48cb-b013-0d3c0a6cc7f5 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:38.291767 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-6ad38bbc-2d43-4632-8357-ec4c0152f8c8 req-af4d6072-5bfc-48cb-b013-0d3c0a6cc7f5 service nova] Creating event network-vif-plugged:7a19e0fe-867b-45fc-9ef7-f883f1a8dbd9 for instance f68eb618-c745-43db-a873-7c0700c0f11c on hv-cinder-81803 Nov 20 03:26:38.296719 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-6ad38bbc-2d43-4632-8357-ec4c0152f8c8 req-af4d6072-5bfc-48cb-b013-0d3c0a6cc7f5 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028520 Nov 20 03:26:38.297309 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 216/360] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:26:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:26:38.387032 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-adb3d504-7329-4a03-8fd3-00b4ad68a49e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:38.388451 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-adb3d504-7329-4a03-8fd3-00b4ad68a49e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:38.394909 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-adb3d504-7329-4a03-8fd3-00b4ad68a49e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:38.395354 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-adb3d504-7329-4a03-8fd3-00b4ad68a49e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:38.396165 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-adb3d504-7329-4a03-8fd3-00b4ad68a49e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:38.396603 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-adb3d504-7329-4a03-8fd3-00b4ad68a49e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:38.528315 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-adb3d504-7329-4a03-8fd3-00b4ad68a49e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:38.535949 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-adb3d504-7329-4a03-8fd3-00b4ad68a49e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:38.537452 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-adb3d504-7329-4a03-8fd3-00b4ad68a49e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:38.538589 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-adb3d504-7329-4a03-8fd3-00b4ad68a49e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1740 microversion: 2.20 time: 0.155616 Nov 20 03:26:38.539148 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 217/361] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:38 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:26:38.790152 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-5e0939c6-e851-40fe-b8e1-a6902db3c9af tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:38.790789 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-5e0939c6-e851-40fe-b8e1-a6902db3c9af tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:38.797029 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5e0939c6-e851-40fe-b8e1-a6902db3c9af tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:38.797481 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5e0939c6-e851-40fe-b8e1-a6902db3c9af tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:38.798255 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5e0939c6-e851-40fe-b8e1-a6902db3c9af tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:38.798689 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5e0939c6-e851-40fe-b8e1-a6902db3c9af tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:38.930087 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-5e0939c6-e851-40fe-b8e1-a6902db3c9af tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:38.937878 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-5e0939c6-e851-40fe-b8e1-a6902db3c9af tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1569 microversion: 2.1 time: 0.151410 Nov 20 03:26:38.938444 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 218/362] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:38 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:39.283513 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-f0277539-eac5-44cc-8b4e-b94c617fd407 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:39.284215 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f0277539-eac5-44cc-8b4e-b94c617fd407 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:39.290194 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f0277539-eac5-44cc-8b4e-b94c617fd407 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:39.290627 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f0277539-eac5-44cc-8b4e-b94c617fd407 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:39.291487 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f0277539-eac5-44cc-8b4e-b94c617fd407 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:39.292032 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f0277539-eac5-44cc-8b4e-b94c617fd407 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:39.438561 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-f0277539-eac5-44cc-8b4e-b94c617fd407 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:39.445809 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-f0277539-eac5-44cc-8b4e-b94c617fd407 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1259 microversion: 2.1 time: 0.166158 Nov 20 03:26:39.446368 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 219/363] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:39 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:39.557699 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-1b11b456-582f-4e9d-8c6b-a45259da4946 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:39.558223 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-1b11b456-582f-4e9d-8c6b-a45259da4946 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:39.565690 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1b11b456-582f-4e9d-8c6b-a45259da4946 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:39.566279 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1b11b456-582f-4e9d-8c6b-a45259da4946 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:39.567136 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1b11b456-582f-4e9d-8c6b-a45259da4946 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:39.567731 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1b11b456-582f-4e9d-8c6b-a45259da4946 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:39.698585 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-1b11b456-582f-4e9d-8c6b-a45259da4946 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:39.707207 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-1b11b456-582f-4e9d-8c6b-a45259da4946 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:39.708736 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-1b11b456-582f-4e9d-8c6b-a45259da4946 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:39.709999 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-1b11b456-582f-4e9d-8c6b-a45259da4946 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1740 microversion: 2.20 time: 0.156052 Nov 20 03:26:39.710521 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 220/364] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:39 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:26:39.954443 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-f397ea31-d140-4a0b-b9b4-79f1d9670cbf tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:39.955061 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f397ea31-d140-4a0b-b9b4-79f1d9670cbf tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:39.961412 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f397ea31-d140-4a0b-b9b4-79f1d9670cbf tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:39.961862 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f397ea31-d140-4a0b-b9b4-79f1d9670cbf tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:39.962647 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f397ea31-d140-4a0b-b9b4-79f1d9670cbf tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:39.963085 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f397ea31-d140-4a0b-b9b4-79f1d9670cbf tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:40.116261 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-f397ea31-d140-4a0b-b9b4-79f1d9670cbf tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:40.124681 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-f397ea31-d140-4a0b-b9b4-79f1d9670cbf tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1569 microversion: 2.1 time: 0.173804 Nov 20 03:26:40.125366 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 221/365] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:39 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:40.176537 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-e2bb5750-70a1-4afb-92ea-ae508aafd9f1 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e62af150-6ab2-4ce8-92cc-0916f5f2465a"}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:40.177668 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-e2bb5750-70a1-4afb-92ea-ae508aafd9f1 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: dcb49ce9-1111-4384-8066-f155f85972d5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:40.183412 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e2bb5750-70a1-4afb-92ea-ae508aafd9f1 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:40.183894 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e2bb5750-70a1-4afb-92ea-ae508aafd9f1 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:40.184713 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e2bb5750-70a1-4afb-92ea-ae508aafd9f1 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:40.185152 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e2bb5750-70a1-4afb-92ea-ae508aafd9f1 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:40.266456 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.wsgi [None req-e2bb5750-70a1-4afb-92ea-ae508aafd9f1 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] HTTP exception thrown: Invalid volume: volume e62af150-6ab2-4ce8-92cc-0916f5f2465a is already attached to instances: dcb49ce9-1111-4384-8066-f155f85972d5 Nov 20 03:26:40.267053 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-e2bb5750-70a1-4afb-92ea-ae508aafd9f1 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Returning 400 to user: Invalid volume: volume e62af150-6ab2-4ce8-92cc-0916f5f2465a is already attached to instances: dcb49ce9-1111-4384-8066-f155f85972d5 {{(pid=116113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:26:40.267914 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-e2bb5750-70a1-4afb-92ea-ae508aafd9f1 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "POST /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095192 Nov 20 03:26:40.268458 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 222/366] 10.222.0.37 () {60 vars in 1322 bytes} [Sat Nov 20 03:26:40 2021] POST /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 20 03:26:40.327353 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-fa6ac7c9-542e-4c13-877d-da8e0ea5685a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:40.327763 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-fa6ac7c9-542e-4c13-877d-da8e0ea5685a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: dcb49ce9-1111-4384-8066-f155f85972d5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:40.334538 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fa6ac7c9-542e-4c13-877d-da8e0ea5685a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:40.334993 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fa6ac7c9-542e-4c13-877d-da8e0ea5685a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:40.335763 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fa6ac7c9-542e-4c13-877d-da8e0ea5685a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:40.336225 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fa6ac7c9-542e-4c13-877d-da8e0ea5685a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:40.412838 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.objects.instance [None req-fa6ac7c9-542e-4c13-877d-da8e0ea5685a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lazy-loading 'services' on Instance uuid dcb49ce9-1111-4384-8066-f155f85972d5 {{(pid=116113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 03:26:40.482897 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-fa6ac7c9-542e-4c13-877d-da8e0ea5685a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "DELETE /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5/os-volume_attachments/e62af150-6ab2-4ce8-92cc-0916f5f2465a" status: 202 len: 0 microversion: 2.1 time: 0.161350 Nov 20 03:26:40.483461 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 223/367] 10.222.0.37 () {58 vars in 1415 bytes} [Sat Nov 20 03:26:40 2021] DELETE /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5/os-volume_attachments/e62af150-6ab2-4ce8-92cc-0916f5f2465a => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 03:26:40.488195 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-0b66131b-25ca-44b2-8768-5b1a58fd2b19 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:40.488909 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-0b66131b-25ca-44b2-8768-5b1a58fd2b19 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:40.494807 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0b66131b-25ca-44b2-8768-5b1a58fd2b19 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:40.495263 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0b66131b-25ca-44b2-8768-5b1a58fd2b19 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:40.496090 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0b66131b-25ca-44b2-8768-5b1a58fd2b19 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:40.496491 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0b66131b-25ca-44b2-8768-5b1a58fd2b19 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:40.635642 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-0b66131b-25ca-44b2-8768-5b1a58fd2b19 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:40.644538 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-0b66131b-25ca-44b2-8768-5b1a58fd2b19 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1259 microversion: 2.1 time: 0.159910 Nov 20 03:26:40.645276 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 224/368] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:40 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:40.649554 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-8e36066a-df56-4ded-999e-28187c29d2d4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:40.650460 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-8e36066a-df56-4ded-999e-28187c29d2d4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: dcb49ce9-1111-4384-8066-f155f85972d5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:40.656369 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8e36066a-df56-4ded-999e-28187c29d2d4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:40.656821 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8e36066a-df56-4ded-999e-28187c29d2d4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:40.657622 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8e36066a-df56-4ded-999e-28187c29d2d4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:40.658062 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8e36066a-df56-4ded-999e-28187c29d2d4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:40.686792 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-8e36066a-df56-4ded-999e-28187c29d2d4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040705 Nov 20 03:26:40.687339 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 225/369] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:26:40 2021] GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:26:40.728595 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-9c06f335-fad2-42b8-b85e-e802a7483cf4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:40.729527 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-9c06f335-fad2-42b8-b85e-e802a7483cf4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:40.735991 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9c06f335-fad2-42b8-b85e-e802a7483cf4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:40.736441 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9c06f335-fad2-42b8-b85e-e802a7483cf4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:40.737264 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9c06f335-fad2-42b8-b85e-e802a7483cf4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:40.737707 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9c06f335-fad2-42b8-b85e-e802a7483cf4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:40.886735 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9c06f335-fad2-42b8-b85e-e802a7483cf4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:40.898932 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9c06f335-fad2-42b8-b85e-e802a7483cf4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:40.900576 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9c06f335-fad2-42b8-b85e-e802a7483cf4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:40.901754 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-9c06f335-fad2-42b8-b85e-e802a7483cf4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1740 microversion: 2.20 time: 0.176943 Nov 20 03:26:40.902499 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 226/370] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:40 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:26:41.141897 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-66820dcf-c396-4124-b83f-3f6eec131b50 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:41.142550 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-66820dcf-c396-4124-b83f-3f6eec131b50 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:41.149139 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-66820dcf-c396-4124-b83f-3f6eec131b50 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:41.149756 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-66820dcf-c396-4124-b83f-3f6eec131b50 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:41.150532 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-66820dcf-c396-4124-b83f-3f6eec131b50 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:41.150970 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-66820dcf-c396-4124-b83f-3f6eec131b50 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:41.286170 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-66820dcf-c396-4124-b83f-3f6eec131b50 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:41.294686 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-66820dcf-c396-4124-b83f-3f6eec131b50 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1569 microversion: 2.1 time: 0.155987 Nov 20 03:26:41.295244 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 227/371] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:41 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:41.661315 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-3557a7d4-7d64-41b0-9acb-6547906493b2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:41.661842 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-3557a7d4-7d64-41b0-9acb-6547906493b2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:41.667736 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3557a7d4-7d64-41b0-9acb-6547906493b2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:41.668218 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3557a7d4-7d64-41b0-9acb-6547906493b2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:41.669596 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3557a7d4-7d64-41b0-9acb-6547906493b2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:41.670032 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3557a7d4-7d64-41b0-9acb-6547906493b2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:41.825739 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.network.neutron [None req-aa8a3bef-88d1-4bfc-bd22-cb54912f545f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] validate_networks() for [('c40b0628-5368-4b0c-8d92-64cd48b8305d', None, None, None, None, None)] {{(pid=116114) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 03:26:41.831397 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-3557a7d4-7d64-41b0-9acb-6547906493b2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:41.838789 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-3557a7d4-7d64-41b0-9acb-6547906493b2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1259 microversion: 2.1 time: 0.181154 Nov 20 03:26:41.849191 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 228/372] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:41 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:41.849191 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-f0710870-b8fb-46a8-b777-cdfc892dd41b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:41.849191 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f0710870-b8fb-46a8-b777-cdfc892dd41b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: dcb49ce9-1111-4384-8066-f155f85972d5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:41.852163 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f0710870-b8fb-46a8-b777-cdfc892dd41b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:41.852620 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f0710870-b8fb-46a8-b777-cdfc892dd41b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:41.853401 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f0710870-b8fb-46a8-b777-cdfc892dd41b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:41.853831 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f0710870-b8fb-46a8-b777-cdfc892dd41b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:41.883012 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-f0710870-b8fb-46a8-b777-cdfc892dd41b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042307 Nov 20 03:26:41.883739 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 229/373] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:26:41 2021] GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 03:26:41.929296 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-9de5b1cd-cef3-46e6-94b2-82992ce13fab tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:41.930161 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-9de5b1cd-cef3-46e6-94b2-82992ce13fab tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:41.948426 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9de5b1cd-cef3-46e6-94b2-82992ce13fab tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:41.949271 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9de5b1cd-cef3-46e6-94b2-82992ce13fab tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:41.950511 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9de5b1cd-cef3-46e6-94b2-82992ce13fab tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:41.950511 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9de5b1cd-cef3-46e6-94b2-82992ce13fab tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:42.205613 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9de5b1cd-cef3-46e6-94b2-82992ce13fab tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:42.214492 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9de5b1cd-cef3-46e6-94b2-82992ce13fab tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:42.216306 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9de5b1cd-cef3-46e6-94b2-82992ce13fab tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:42.217730 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-9de5b1cd-cef3-46e6-94b2-82992ce13fab tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1740 microversion: 2.20 time: 0.292217 Nov 20 03:26:42.218284 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 230/374] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:41 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1740 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:26:42.223052 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-957d3cde-7759-40e1-bf0a-ba63e9097cf8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1453647103", "imageRef": "e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0", "flavorRef": "452", "networks": [{"uuid": "a1acacc5-2d91-42ad-971f-cecd3a0dc9a5"}]}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:42.314965 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-aa8a3bef-88d1-4bfc-bd22-cb54912f545f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Flavor limits 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 03:26:42.315579 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-aa8a3bef-88d1-4bfc-bd22-cb54912f545f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Image limits 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 03:26:42.316226 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-aa8a3bef-88d1-4bfc-bd22-cb54912f545f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Flavor pref 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 03:26:42.316730 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-aa8a3bef-88d1-4bfc-bd22-cb54912f545f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Image pref 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 03:26:42.317151 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-aa8a3bef-88d1-4bfc-bd22-cb54912f545f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 03:26:42.328812 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-aa8a3bef-88d1-4bfc-bd22-cb54912f545f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:42.329263 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-aa8a3bef-88d1-4bfc-bd22-cb54912f545f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:42.330112 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-aa8a3bef-88d1-4bfc-bd22-cb54912f545f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:42.330548 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-aa8a3bef-88d1-4bfc-bd22-cb54912f545f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:42.347174 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-aa8a3bef-88d1-4bfc-bd22-cb54912f545f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Getting quotas for project 3619424d1b174797a1d4f1370072ff9f. Resources: {'ram', 'cores', 'instances'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:26:42.351045 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-aa8a3bef-88d1-4bfc-bd22-cb54912f545f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Getting quotas for user 459d890323c24949b698061a926af1ab and project 3619424d1b174797a1d4f1370072ff9f. Resources: {'ram', 'cores', 'instances'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:26:42.362738 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-aa8a3bef-88d1-4bfc-bd22-cb54912f545f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Going to run 1 instances... {{(pid=116114) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 03:26:42.365308 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-aa8a3bef-88d1-4bfc-bd22-cb54912f545f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: 4111c671-ac86-42f4-8753-e38deb7c21a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 03:26:42.409647 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-aa8a3bef-88d1-4bfc-bd22-cb54912f545f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 23.387494 Nov 20 03:26:42.410291 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 145/375] 10.222.0.37 () {60 vars in 1146 bytes} [Sat Nov 20 03:26:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 23389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 03:26:42.423389 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-91c366c3-ec54-4bde-8003-a05d4576008e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:42.424108 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-91c366c3-ec54-4bde-8003-a05d4576008e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:42.430362 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-91c366c3-ec54-4bde-8003-a05d4576008e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:42.430742 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-91c366c3-ec54-4bde-8003-a05d4576008e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:42.431625 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-91c366c3-ec54-4bde-8003-a05d4576008e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:42.435224 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-91c366c3-ec54-4bde-8003-a05d4576008e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:42.587388 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-91c366c3-ec54-4bde-8003-a05d4576008e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:42.595647 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-91c366c3-ec54-4bde-8003-a05d4576008e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1569 microversion: 2.1 time: 0.184363 Nov 20 03:26:42.596745 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 146/376] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:42 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:42.601712 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-2c75dc31-4a37-4d2c-91b0-fe506dce0149 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:42.602497 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-2c75dc31-4a37-4d2c-91b0-fe506dce0149 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: 4111c671-ac86-42f4-8753-e38deb7c21a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:42.673908 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-2c75dc31-4a37-4d2c-91b0-fe506dce0149 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:42.682875 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-2c75dc31-4a37-4d2c-91b0-fe506dce0149 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0" status: 200 len: 1212 microversion: 2.1 time: 0.084871 Nov 20 03:26:42.683635 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 147/377] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:42 2021] GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0 => generated 1212 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:42.858017 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-d948ba9e-6b20-4d69-ba50-1c9c14e2d431 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:42.858740 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-d948ba9e-6b20-4d69-ba50-1c9c14e2d431 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:42.865434 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d948ba9e-6b20-4d69-ba50-1c9c14e2d431 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:42.866209 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d948ba9e-6b20-4d69-ba50-1c9c14e2d431 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:42.867223 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d948ba9e-6b20-4d69-ba50-1c9c14e2d431 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:42.867737 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d948ba9e-6b20-4d69-ba50-1c9c14e2d431 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:43.082998 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-d948ba9e-6b20-4d69-ba50-1c9c14e2d431 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:43.092465 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-d948ba9e-6b20-4d69-ba50-1c9c14e2d431 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1259 microversion: 2.1 time: 0.239463 Nov 20 03:26:43.093238 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 148/378] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:42 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1259 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:43.239393 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-47239676-907d-4723-ae38-7678a4d49e8b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:43.241059 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-47239676-907d-4723-ae38-7678a4d49e8b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:43.253428 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-47239676-907d-4723-ae38-7678a4d49e8b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:43.254204 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-47239676-907d-4723-ae38-7678a4d49e8b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:43.255710 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-47239676-907d-4723-ae38-7678a4d49e8b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:43.256669 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-47239676-907d-4723-ae38-7678a4d49e8b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:43.493750 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-47239676-907d-4723-ae38-7678a4d49e8b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:43.507815 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-47239676-907d-4723-ae38-7678a4d49e8b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:43.509318 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-47239676-907d-4723-ae38-7678a4d49e8b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:43.510492 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-47239676-907d-4723-ae38-7678a4d49e8b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1740 microversion: 2.20 time: 0.277754 Nov 20 03:26:43.511036 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 149/379] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:43 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1740 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:26:43.616109 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-0e755903-2b13-4870-990a-3ffd55851cc9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:43.617106 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-0e755903-2b13-4870-990a-3ffd55851cc9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:43.626577 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0e755903-2b13-4870-990a-3ffd55851cc9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:43.627626 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0e755903-2b13-4870-990a-3ffd55851cc9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:43.629384 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0e755903-2b13-4870-990a-3ffd55851cc9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:43.630147 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0e755903-2b13-4870-990a-3ffd55851cc9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:43.796844 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-0e755903-2b13-4870-990a-3ffd55851cc9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:43.805991 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-0e755903-2b13-4870-990a-3ffd55851cc9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1569 microversion: 2.1 time: 0.193353 Nov 20 03:26:43.818845 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 150/380] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:43 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1569 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:43.825526 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-a6451945-810e-498c-a510-d41476d5fe97 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:43.826540 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-a6451945-810e-498c-a510-d41476d5fe97 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: 4111c671-ac86-42f4-8753-e38deb7c21a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:43.847327 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a6451945-810e-498c-a510-d41476d5fe97 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:43.847778 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a6451945-810e-498c-a510-d41476d5fe97 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:43.848902 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a6451945-810e-498c-a510-d41476d5fe97 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:43.849355 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a6451945-810e-498c-a510-d41476d5fe97 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:43.957060 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-a6451945-810e-498c-a510-d41476d5fe97 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:43.967598 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-a6451945-810e-498c-a510-d41476d5fe97 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0" status: 200 len: 1264 microversion: 2.1 time: 0.147296 Nov 20 03:26:43.978289 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 151/381] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:43 2021] GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:44.115182 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-82b76914-9d88-41b1-a3ed-498df33e61dd tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:44.115834 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-82b76914-9d88-41b1-a3ed-498df33e61dd tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:44.124053 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-82b76914-9d88-41b1-a3ed-498df33e61dd tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:44.124509 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-82b76914-9d88-41b1-a3ed-498df33e61dd tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:44.140798 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-82b76914-9d88-41b1-a3ed-498df33e61dd tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:44.141874 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-82b76914-9d88-41b1-a3ed-498df33e61dd tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:44.255758 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.network.neutron [None req-957d3cde-7759-40e1-bf0a-ba63e9097cf8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] validate_networks() for [('a1acacc5-2d91-42ad-971f-cecd3a0dc9a5', None, None, None, None, None)] {{(pid=116113) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 03:26:44.563658 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-82b76914-9d88-41b1-a3ed-498df33e61dd tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:44.573872 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-82b76914-9d88-41b1-a3ed-498df33e61dd tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1259 microversion: 2.1 time: 0.463784 Nov 20 03:26:44.583184 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 152/382] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:44 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1259 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:44.587982 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-eedf9fc4-2922-4bcc-ba78-062ff5f3978e req-cdd737ac-19db-4130-ab54-dc7ea05c5d12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd", "name": "network-vif-plugged", "status": "completed", "tag": "c4f59d4b-9c47-44dc-ae92-832b37f470bd"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:44.593857 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:26:44.593857 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:26:44.609118 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-eedf9fc4-2922-4bcc-ba78-062ff5f3978e req-cdd737ac-19db-4130-ab54-dc7ea05c5d12 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:44.609924 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-eedf9fc4-2922-4bcc-ba78-062ff5f3978e req-cdd737ac-19db-4130-ab54-dc7ea05c5d12 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:44.621243 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-eedf9fc4-2922-4bcc-ba78-062ff5f3978e req-cdd737ac-19db-4130-ab54-dc7ea05c5d12 service nova] Creating event network-vif-plugged:c4f59d4b-9c47-44dc-ae92-832b37f470bd for instance 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd on hv-cinder-81803 Nov 20 03:26:44.633257 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-eedf9fc4-2922-4bcc-ba78-062ff5f3978e req-cdd737ac-19db-4130-ab54-dc7ea05c5d12 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048547 Nov 20 03:26:44.634183 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 153/383] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:26:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:26:44.643397 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-adb19180-2e1e-4ac1-ac8c-d3a1f9bdbac8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:44.644119 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-adb19180-2e1e-4ac1-ac8c-d3a1f9bdbac8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:44.653772 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-adb19180-2e1e-4ac1-ac8c-d3a1f9bdbac8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:44.654682 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-adb19180-2e1e-4ac1-ac8c-d3a1f9bdbac8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:44.655004 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-adb19180-2e1e-4ac1-ac8c-d3a1f9bdbac8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:44.655801 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-adb19180-2e1e-4ac1-ac8c-d3a1f9bdbac8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:45.339877 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-adb19180-2e1e-4ac1-ac8c-d3a1f9bdbac8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:45.356931 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-adb19180-2e1e-4ac1-ac8c-d3a1f9bdbac8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:45.359029 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-adb19180-2e1e-4ac1-ac8c-d3a1f9bdbac8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:45.360556 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-adb19180-2e1e-4ac1-ac8c-d3a1f9bdbac8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1740 microversion: 2.20 time: 0.725351 Nov 20 03:26:45.361170 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 154/384] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:44 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1740 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:26:45.369063 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-d1f34e9f-9632-4615-9c05-97006e10f03d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:45.380061 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-d1f34e9f-9632-4615-9c05-97006e10f03d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:45.389623 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d1f34e9f-9632-4615-9c05-97006e10f03d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:45.390537 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d1f34e9f-9632-4615-9c05-97006e10f03d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:45.391559 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d1f34e9f-9632-4615-9c05-97006e10f03d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:45.392318 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d1f34e9f-9632-4615-9c05-97006e10f03d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:45.458935 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-957d3cde-7759-40e1-bf0a-ba63e9097cf8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Flavor limits 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 03:26:45.459548 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-957d3cde-7759-40e1-bf0a-ba63e9097cf8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Image limits 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 03:26:45.459828 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-957d3cde-7759-40e1-bf0a-ba63e9097cf8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Flavor pref 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 03:26:45.460235 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-957d3cde-7759-40e1-bf0a-ba63e9097cf8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Image pref 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 03:26:45.460832 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-957d3cde-7759-40e1-bf0a-ba63e9097cf8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 03:26:45.472388 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-957d3cde-7759-40e1-bf0a-ba63e9097cf8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:45.473355 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-957d3cde-7759-40e1-bf0a-ba63e9097cf8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:45.474337 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-957d3cde-7759-40e1-bf0a-ba63e9097cf8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:45.474939 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-957d3cde-7759-40e1-bf0a-ba63e9097cf8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:45.493479 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-957d3cde-7759-40e1-bf0a-ba63e9097cf8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Getting quotas for project 0fdf6e7abf574b269f3c1459a9d58c26. Resources: {'ram', 'cores', 'instances'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:26:45.497739 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-957d3cde-7759-40e1-bf0a-ba63e9097cf8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Getting quotas for user e05b767f39ea49e4aa916c818a4290e7 and project 0fdf6e7abf574b269f3c1459a9d58c26. Resources: {'ram', 'cores', 'instances'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:26:45.510287 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-957d3cde-7759-40e1-bf0a-ba63e9097cf8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Going to run 1 instances... {{(pid=116113) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 03:26:45.513226 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-957d3cde-7759-40e1-bf0a-ba63e9097cf8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 03:26:45.560099 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-957d3cde-7759-40e1-bf0a-ba63e9097cf8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.340408 Nov 20 03:26:45.565894 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 231/385] 10.222.0.37 () {60 vars in 1146 bytes} [Sat Nov 20 03:26:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 3346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 03:26:45.571529 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-3d59eda8-c06a-4811-8595-be0725d028d8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:45.572713 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-3d59eda8-c06a-4811-8595-be0725d028d8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: 4111c671-ac86-42f4-8753-e38deb7c21a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:45.581259 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3d59eda8-c06a-4811-8595-be0725d028d8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:45.582846 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3d59eda8-c06a-4811-8595-be0725d028d8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:45.584350 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3d59eda8-c06a-4811-8595-be0725d028d8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:45.585488 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3d59eda8-c06a-4811-8595-be0725d028d8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:45.792186 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-d1f34e9f-9632-4615-9c05-97006e10f03d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:45.801551 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-d1f34e9f-9632-4615-9c05-97006e10f03d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1569 microversion: 2.1 time: 0.439140 Nov 20 03:26:45.812388 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 155/386] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:45 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1569 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:45.826591 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-9508a617-ca0a-4963-8644-cb4f40e367ee tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:45.827016 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-9508a617-ca0a-4963-8644-cb4f40e367ee tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:45.946642 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-9508a617-ca0a-4963-8644-cb4f40e367ee tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:45.953874 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-9508a617-ca0a-4963-8644-cb4f40e367ee tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 200 len: 1218 microversion: 2.1 time: 0.148145 Nov 20 03:26:45.958023 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 156/387] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:45 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 1218 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:45.964936 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-3d59eda8-c06a-4811-8595-be0725d028d8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:45.972629 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-3d59eda8-c06a-4811-8595-be0725d028d8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0" status: 200 len: 1312 microversion: 2.1 time: 0.405523 Nov 20 03:26:45.973449 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 232/388] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:45 2021] GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0 => generated 1312 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:45.974683 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-a0c24fa5-1710-4dc6-b401-44a93f6f2de1 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:45.975475 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-a0c24fa5-1710-4dc6-b401-44a93f6f2de1 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:45.982083 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a0c24fa5-1710-4dc6-b401-44a93f6f2de1 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:45.983108 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a0c24fa5-1710-4dc6-b401-44a93f6f2de1 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:45.984116 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a0c24fa5-1710-4dc6-b401-44a93f6f2de1 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:45.984716 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a0c24fa5-1710-4dc6-b401-44a93f6f2de1 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:46.320322 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-a0c24fa5-1710-4dc6-b401-44a93f6f2de1 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:46.328371 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-a0c24fa5-1710-4dc6-b401-44a93f6f2de1 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1259 microversion: 2.1 time: 0.369192 Nov 20 03:26:46.338269 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 157/389] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:45 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1259 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:46.382730 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-8d10f352-408f-45f7-b8b9-7ed3b5208213 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:46.383624 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-8d10f352-408f-45f7-b8b9-7ed3b5208213 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:46.395456 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8d10f352-408f-45f7-b8b9-7ed3b5208213 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:46.396224 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8d10f352-408f-45f7-b8b9-7ed3b5208213 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:46.397029 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8d10f352-408f-45f7-b8b9-7ed3b5208213 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:46.402006 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8d10f352-408f-45f7-b8b9-7ed3b5208213 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:46.664994 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-8d10f352-408f-45f7-b8b9-7ed3b5208213 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:46.675524 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-8d10f352-408f-45f7-b8b9-7ed3b5208213 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:46.677288 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-8d10f352-408f-45f7-b8b9-7ed3b5208213 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:46.678634 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-8d10f352-408f-45f7-b8b9-7ed3b5208213 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1740 microversion: 2.20 time: 0.300549 Nov 20 03:26:46.679825 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 233/390] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:46 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1740 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:26:46.828943 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-1f6f136d-784b-4664-a6cb-13959449b090 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:46.830317 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-1f6f136d-784b-4664-a6cb-13959449b090 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:46.838547 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1f6f136d-784b-4664-a6cb-13959449b090 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:46.839201 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1f6f136d-784b-4664-a6cb-13959449b090 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:46.840011 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1f6f136d-784b-4664-a6cb-13959449b090 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:46.841140 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1f6f136d-784b-4664-a6cb-13959449b090 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:46.971687 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-9da60ea2-ad87-4e40-8e01-337ef4536724 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:46.972332 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-9da60ea2-ad87-4e40-8e01-337ef4536724 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:46.979855 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9da60ea2-ad87-4e40-8e01-337ef4536724 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:46.980523 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9da60ea2-ad87-4e40-8e01-337ef4536724 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:46.981540 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9da60ea2-ad87-4e40-8e01-337ef4536724 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:46.981981 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9da60ea2-ad87-4e40-8e01-337ef4536724 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:47.085883 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9da60ea2-ad87-4e40-8e01-337ef4536724 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:47.106376 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-9da60ea2-ad87-4e40-8e01-337ef4536724 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 200 len: 1270 microversion: 2.1 time: 0.137997 Nov 20 03:26:47.107851 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 234/391] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:46 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 1270 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:47.112611 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ea08ce5e-385b-4c69-8c4b-0ada9ae6cb03 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:47.113788 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ea08ce5e-385b-4c69-8c4b-0ada9ae6cb03 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: 4111c671-ac86-42f4-8753-e38deb7c21a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:47.125246 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ea08ce5e-385b-4c69-8c4b-0ada9ae6cb03 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:47.126003 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ea08ce5e-385b-4c69-8c4b-0ada9ae6cb03 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:47.126989 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ea08ce5e-385b-4c69-8c4b-0ada9ae6cb03 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:47.127538 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ea08ce5e-385b-4c69-8c4b-0ada9ae6cb03 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:47.155486 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-1f6f136d-784b-4664-a6cb-13959449b090 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:47.163689 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-1f6f136d-784b-4664-a6cb-13959449b090 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1569 microversion: 2.1 time: 0.338331 Nov 20 03:26:47.164618 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 158/392] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:46 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1569 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:47.172132 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-c94d7c08-1bc0-4f6f-ad2e-22c91a61419f req-ff20dd03-da6e-4bbd-acab-a41f5857a914 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4111c671-ac86-42f4-8753-e38deb7c21a0", "tag": "0af31e15-9931-4f34-8890-97b152868a29"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:47.173970 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:26:47.173970 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:26:47.181810 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-c94d7c08-1bc0-4f6f-ad2e-22c91a61419f req-ff20dd03-da6e-4bbd-acab-a41f5857a914 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:47.182495 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-c94d7c08-1bc0-4f6f-ad2e-22c91a61419f req-ff20dd03-da6e-4bbd-acab-a41f5857a914 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:47.208749 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-c94d7c08-1bc0-4f6f-ad2e-22c91a61419f req-ff20dd03-da6e-4bbd-acab-a41f5857a914 service nova] Creating event network-changed:0af31e15-9931-4f34-8890-97b152868a29 for instance 4111c671-ac86-42f4-8753-e38deb7c21a0 on hv-cinder-81803 Nov 20 03:26:47.215081 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-c94d7c08-1bc0-4f6f-ad2e-22c91a61419f req-ff20dd03-da6e-4bbd-acab-a41f5857a914 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048588 Nov 20 03:26:47.218456 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 159/393] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:26:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:26:47.295898 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-ea08ce5e-385b-4c69-8c4b-0ada9ae6cb03 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:47.304526 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ea08ce5e-385b-4c69-8c4b-0ada9ae6cb03 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0" status: 200 len: 1312 microversion: 2.1 time: 0.195259 Nov 20 03:26:47.305525 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 235/394] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:47 2021] GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0 => generated 1312 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:47.350764 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-ffdc1233-08ee-4596-8ed3-10f3c5ee76e2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:47.351537 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-ffdc1233-08ee-4596-8ed3-10f3c5ee76e2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:47.370988 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ffdc1233-08ee-4596-8ed3-10f3c5ee76e2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:47.371412 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ffdc1233-08ee-4596-8ed3-10f3c5ee76e2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:47.373127 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ffdc1233-08ee-4596-8ed3-10f3c5ee76e2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:47.373590 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ffdc1233-08ee-4596-8ed3-10f3c5ee76e2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:47.701424 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-130240ea-9a98-4c70-8c31-1b87fd78000b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:47.702911 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-130240ea-9a98-4c70-8c31-1b87fd78000b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:47.709896 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-ffdc1233-08ee-4596-8ed3-10f3c5ee76e2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:47.716445 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-130240ea-9a98-4c70-8c31-1b87fd78000b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:47.717634 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-ffdc1233-08ee-4596-8ed3-10f3c5ee76e2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1259 microversion: 2.1 time: 0.375894 Nov 20 03:26:47.720740 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 160/395] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:47 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1259 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:47.721300 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-130240ea-9a98-4c70-8c31-1b87fd78000b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:47.722516 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-130240ea-9a98-4c70-8c31-1b87fd78000b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:47.725138 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-130240ea-9a98-4c70-8c31-1b87fd78000b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:48.003305 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-130240ea-9a98-4c70-8c31-1b87fd78000b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:48.011377 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-130240ea-9a98-4c70-8c31-1b87fd78000b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:48.013277 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-130240ea-9a98-4c70-8c31-1b87fd78000b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:48.014470 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-130240ea-9a98-4c70-8c31-1b87fd78000b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1740 microversion: 2.20 time: 0.317503 Nov 20 03:26:48.015175 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 236/396] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:47 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1740 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:26:48.124659 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-d72d40cf-7061-4705-bfaa-0e16b9075c8f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:48.125664 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-d72d40cf-7061-4705-bfaa-0e16b9075c8f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:48.138026 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d72d40cf-7061-4705-bfaa-0e16b9075c8f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:48.138937 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d72d40cf-7061-4705-bfaa-0e16b9075c8f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:48.141800 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d72d40cf-7061-4705-bfaa-0e16b9075c8f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:48.142258 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d72d40cf-7061-4705-bfaa-0e16b9075c8f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:48.180742 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-3b6b4bcb-764b-488d-8724-e9329fbf89ee tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:48.181633 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-3b6b4bcb-764b-488d-8724-e9329fbf89ee tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:48.188197 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3b6b4bcb-764b-488d-8724-e9329fbf89ee tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:48.188873 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3b6b4bcb-764b-488d-8724-e9329fbf89ee tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:48.189818 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3b6b4bcb-764b-488d-8724-e9329fbf89ee tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:48.190422 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3b6b4bcb-764b-488d-8724-e9329fbf89ee tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:48.220931 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-d72d40cf-7061-4705-bfaa-0e16b9075c8f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:48.231672 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-d72d40cf-7061-4705-bfaa-0e16b9075c8f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 200 len: 1276 microversion: 2.1 time: 0.111052 Nov 20 03:26:48.234356 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 161/397] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:48 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 1276 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:48.322073 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-8acd62ec-25b1-477a-99da-c0703708906d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:48.322799 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-8acd62ec-25b1-477a-99da-c0703708906d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: 4111c671-ac86-42f4-8753-e38deb7c21a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:48.331721 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8acd62ec-25b1-477a-99da-c0703708906d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:48.332447 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8acd62ec-25b1-477a-99da-c0703708906d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:48.333268 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8acd62ec-25b1-477a-99da-c0703708906d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:48.333735 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8acd62ec-25b1-477a-99da-c0703708906d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:48.535440 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-3b6b4bcb-764b-488d-8724-e9329fbf89ee tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:48.552654 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-3b6b4bcb-764b-488d-8724-e9329fbf89ee tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1569 microversion: 2.1 time: 0.375364 Nov 20 03:26:48.553222 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 237/398] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:48 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1569 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:48.691901 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-8acd62ec-25b1-477a-99da-c0703708906d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:48.700803 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-8acd62ec-25b1-477a-99da-c0703708906d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0" status: 200 len: 1312 microversion: 2.1 time: 0.382349 Nov 20 03:26:48.722543 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 162/399] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:48 2021] GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0 => generated 1312 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:48.736855 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-06d58dbd-7217-464e-989b-762affdad50d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:48.737764 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-06d58dbd-7217-464e-989b-762affdad50d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:48.746791 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-06d58dbd-7217-464e-989b-762affdad50d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:48.751089 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-06d58dbd-7217-464e-989b-762affdad50d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:48.752053 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-06d58dbd-7217-464e-989b-762affdad50d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:48.752583 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-06d58dbd-7217-464e-989b-762affdad50d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:49.033782 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-7c99c238-7bc2-41cf-b09e-0b06d13f2dee tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:49.034647 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-7c99c238-7bc2-41cf-b09e-0b06d13f2dee tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:49.041365 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7c99c238-7bc2-41cf-b09e-0b06d13f2dee tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:49.042092 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7c99c238-7bc2-41cf-b09e-0b06d13f2dee tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:49.043043 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7c99c238-7bc2-41cf-b09e-0b06d13f2dee tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:49.043664 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7c99c238-7bc2-41cf-b09e-0b06d13f2dee tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:49.397753 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-06d58dbd-7217-464e-989b-762affdad50d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:49.405081 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-06d58dbd-7217-464e-989b-762affdad50d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1443 microversion: 2.1 time: 0.671837 Nov 20 03:26:49.405642 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 238/400] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:48 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1443 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:49.421780 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-0aa2edd6-2b1b-43f9-b1d2-b0130a816753 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:49.422387 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-0aa2edd6-2b1b-43f9-b1d2-b0130a816753 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:49.428399 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0aa2edd6-2b1b-43f9-b1d2-b0130a816753 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:49.428854 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0aa2edd6-2b1b-43f9-b1d2-b0130a816753 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:49.429634 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0aa2edd6-2b1b-43f9-b1d2-b0130a816753 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:49.430070 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0aa2edd6-2b1b-43f9-b1d2-b0130a816753 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:49.477295 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-7c99c238-7bc2-41cf-b09e-0b06d13f2dee tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:49.492918 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-7c99c238-7bc2-41cf-b09e-0b06d13f2dee tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:49.495049 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-7c99c238-7bc2-41cf-b09e-0b06d13f2dee tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:49.497637 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-7c99c238-7bc2-41cf-b09e-0b06d13f2dee tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1740 microversion: 2.20 time: 0.466787 Nov 20 03:26:49.498897 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 163/401] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:49 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1740 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:26:49.507598 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-792b0251-6588-4921-8cdc-1db7ac18cf11 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:49.509332 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-792b0251-6588-4921-8cdc-1db7ac18cf11 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:49.520376 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-792b0251-6588-4921-8cdc-1db7ac18cf11 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:49.520942 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-792b0251-6588-4921-8cdc-1db7ac18cf11 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:49.522009 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-792b0251-6588-4921-8cdc-1db7ac18cf11 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:49.522559 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-792b0251-6588-4921-8cdc-1db7ac18cf11 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:49.845511 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-0aa2edd6-2b1b-43f9-b1d2-b0130a816753 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:49.853157 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-0aa2edd6-2b1b-43f9-b1d2-b0130a816753 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 200 len: 1318 microversion: 2.1 time: 0.446377 Nov 20 03:26:49.853816 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 239/402] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:49 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:49.858780 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-1cf7d341-10da-4fe2-a050-b6cb14a6d365 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:49.859505 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-1cf7d341-10da-4fe2-a050-b6cb14a6d365 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:49.865331 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1cf7d341-10da-4fe2-a050-b6cb14a6d365 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:49.865866 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1cf7d341-10da-4fe2-a050-b6cb14a6d365 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:49.866724 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1cf7d341-10da-4fe2-a050-b6cb14a6d365 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:49.867448 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1cf7d341-10da-4fe2-a050-b6cb14a6d365 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:49.959515 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-792b0251-6588-4921-8cdc-1db7ac18cf11 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:49.968065 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-792b0251-6588-4921-8cdc-1db7ac18cf11 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1443 microversion: 2.1 time: 0.467911 Nov 20 03:26:49.968551 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 164/403] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:49 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1443 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:49.972858 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-f18410cf-500d-4d22-bc7d-6f8e40c7a2ae tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:49.973715 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-f18410cf-500d-4d22-bc7d-6f8e40c7a2ae tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: 4111c671-ac86-42f4-8753-e38deb7c21a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:49.980765 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f18410cf-500d-4d22-bc7d-6f8e40c7a2ae tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:49.981089 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f18410cf-500d-4d22-bc7d-6f8e40c7a2ae tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:49.982485 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f18410cf-500d-4d22-bc7d-6f8e40c7a2ae tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:49.982485 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f18410cf-500d-4d22-bc7d-6f8e40c7a2ae tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:50.184911 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-1cf7d341-10da-4fe2-a050-b6cb14a6d365 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:50.194957 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-1cf7d341-10da-4fe2-a050-b6cb14a6d365 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1569 microversion: 2.1 time: 0.339768 Nov 20 03:26:50.196108 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 240/404] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:49 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1569 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:50.256678 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-f18410cf-500d-4d22-bc7d-6f8e40c7a2ae tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:50.268673 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-f18410cf-500d-4d22-bc7d-6f8e40c7a2ae tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0" status: 200 len: 1312 microversion: 2.1 time: 0.298932 Nov 20 03:26:50.281878 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 165/405] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:49 2021] GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0 => generated 1312 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:50.461287 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-693a1357-e97a-4d89-a51c-cf9f6544a4d9 req-92432cd6-ea4d-4678-ac86-e16bb6947b8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36116e65-2e67-4d18-84c2-d699cae54285", "tag": "502d5837-eaef-4602-9057-cc1f1bb18eb2"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:50.463060 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:26:50.463060 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:26:50.470683 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-693a1357-e97a-4d89-a51c-cf9f6544a4d9 req-92432cd6-ea4d-4678-ac86-e16bb6947b8e service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:50.471278 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-693a1357-e97a-4d89-a51c-cf9f6544a4d9 req-92432cd6-ea4d-4678-ac86-e16bb6947b8e service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:50.483322 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-693a1357-e97a-4d89-a51c-cf9f6544a4d9 req-92432cd6-ea4d-4678-ac86-e16bb6947b8e service nova] Creating event network-changed:502d5837-eaef-4602-9057-cc1f1bb18eb2 for instance 36116e65-2e67-4d18-84c2-d699cae54285 on hv-cinder-81803 Nov 20 03:26:50.488324 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-693a1357-e97a-4d89-a51c-cf9f6544a4d9 req-92432cd6-ea4d-4678-ac86-e16bb6947b8e service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030684 Nov 20 03:26:50.489161 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 241/406] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:26:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:26:50.516454 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-9b53f953-6704-452a-8faf-934885b4bbe1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:50.517068 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-9b53f953-6704-452a-8faf-934885b4bbe1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:50.523460 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9b53f953-6704-452a-8faf-934885b4bbe1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:50.524013 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9b53f953-6704-452a-8faf-934885b4bbe1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:50.525001 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9b53f953-6704-452a-8faf-934885b4bbe1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:50.525435 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9b53f953-6704-452a-8faf-934885b4bbe1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:50.774833 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-9b53f953-6704-452a-8faf-934885b4bbe1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:50.809954 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-9b53f953-6704-452a-8faf-934885b4bbe1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:50.811777 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-9b53f953-6704-452a-8faf-934885b4bbe1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:50.813462 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-9b53f953-6704-452a-8faf-934885b4bbe1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1740 microversion: 2.20 time: 0.301293 Nov 20 03:26:50.824755 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 166/407] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:50 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1740 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:26:50.894074 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-aa6c3b83-612a-441f-aef6-323bb507eb04 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:50.894074 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-aa6c3b83-612a-441f-aef6-323bb507eb04 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:50.894923 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-aa6c3b83-612a-441f-aef6-323bb507eb04 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:50.895606 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-aa6c3b83-612a-441f-aef6-323bb507eb04 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:50.898319 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-aa6c3b83-612a-441f-aef6-323bb507eb04 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:50.900491 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-aa6c3b83-612a-441f-aef6-323bb507eb04 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:51.212571 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-0e56d998-8ff5-4489-8365-029517ce6c21 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:51.213506 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-0e56d998-8ff5-4489-8365-029517ce6c21 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:51.220710 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0e56d998-8ff5-4489-8365-029517ce6c21 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:51.221397 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0e56d998-8ff5-4489-8365-029517ce6c21 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:51.222344 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0e56d998-8ff5-4489-8365-029517ce6c21 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:51.222928 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0e56d998-8ff5-4489-8365-029517ce6c21 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:51.482907 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-aa6c3b83-612a-441f-aef6-323bb507eb04 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:51.491683 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-aa6c3b83-612a-441f-aef6-323bb507eb04 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 200 len: 1318 microversion: 2.1 time: 0.624728 Nov 20 03:26:51.495734 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 242/408] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:50 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 1318 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:51.502760 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-257046bc-7a40-4807-a712-fb48f792a54c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:51.513910 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-257046bc-7a40-4807-a712-fb48f792a54c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: 4111c671-ac86-42f4-8753-e38deb7c21a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:51.537319 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-257046bc-7a40-4807-a712-fb48f792a54c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:51.538194 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-257046bc-7a40-4807-a712-fb48f792a54c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:51.539242 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-257046bc-7a40-4807-a712-fb48f792a54c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:51.539779 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-257046bc-7a40-4807-a712-fb48f792a54c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:51.648235 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-0e56d998-8ff5-4489-8365-029517ce6c21 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:51.666749 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-0e56d998-8ff5-4489-8365-029517ce6c21 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1569 microversion: 2.1 time: 0.452003 Nov 20 03:26:51.668721 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 167/409] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:51 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1569 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:51.832990 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-23d97bed-67b9-46d7-9a6a-30a543440b5b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:51.833929 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-23d97bed-67b9-46d7-9a6a-30a543440b5b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:51.844025 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-23d97bed-67b9-46d7-9a6a-30a543440b5b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:51.845955 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-23d97bed-67b9-46d7-9a6a-30a543440b5b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:51.849637 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-23d97bed-67b9-46d7-9a6a-30a543440b5b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:51.850363 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-23d97bed-67b9-46d7-9a6a-30a543440b5b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:51.912778 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-257046bc-7a40-4807-a712-fb48f792a54c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:51.935980 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-257046bc-7a40-4807-a712-fb48f792a54c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0" status: 200 len: 1312 microversion: 2.1 time: 0.435404 Nov 20 03:26:51.938749 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 243/410] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:51 2021] GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0 => generated 1312 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:52.241328 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-23d97bed-67b9-46d7-9a6a-30a543440b5b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:52.250722 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-23d97bed-67b9-46d7-9a6a-30a543440b5b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:52.255123 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-23d97bed-67b9-46d7-9a6a-30a543440b5b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:52.258082 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-23d97bed-67b9-46d7-9a6a-30a543440b5b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1740 microversion: 2.20 time: 0.429570 Nov 20 03:26:52.260484 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 168/411] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:51 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1740 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:26:52.510275 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-38fd7150-46e7-485a-9241-7bfd81b2b787 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:52.511075 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-38fd7150-46e7-485a-9241-7bfd81b2b787 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:52.517345 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-38fd7150-46e7-485a-9241-7bfd81b2b787 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:52.518021 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-38fd7150-46e7-485a-9241-7bfd81b2b787 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:52.518916 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-38fd7150-46e7-485a-9241-7bfd81b2b787 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:52.519560 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-38fd7150-46e7-485a-9241-7bfd81b2b787 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:52.642335 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-aa4b5a5f-1e8a-4ec6-802e-ed40329fdb8b req-9c455f90-59c3-4409-900f-5b78fcf66949 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd", "tag": "c4f59d4b-9c47-44dc-ae92-832b37f470bd"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:52.642335 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:26:52.642335 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:26:52.656606 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-aa4b5a5f-1e8a-4ec6-802e-ed40329fdb8b req-9c455f90-59c3-4409-900f-5b78fcf66949 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:52.657184 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-aa4b5a5f-1e8a-4ec6-802e-ed40329fdb8b req-9c455f90-59c3-4409-900f-5b78fcf66949 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:52.684526 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-aa4b5a5f-1e8a-4ec6-802e-ed40329fdb8b req-9c455f90-59c3-4409-900f-5b78fcf66949 service nova] Creating event network-changed:c4f59d4b-9c47-44dc-ae92-832b37f470bd for instance 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd on hv-cinder-81803 Nov 20 03:26:52.690110 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-aa4b5a5f-1e8a-4ec6-802e-ed40329fdb8b req-9c455f90-59c3-4409-900f-5b78fcf66949 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057139 Nov 20 03:26:52.707872 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 169/412] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:26:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:26:52.722322 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-e41be859-a450-444f-8f48-d937d0f6f908 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:52.724570 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-e41be859-a450-444f-8f48-d937d0f6f908 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:52.733247 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e41be859-a450-444f-8f48-d937d0f6f908 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:52.733952 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e41be859-a450-444f-8f48-d937d0f6f908 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:52.744051 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e41be859-a450-444f-8f48-d937d0f6f908 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:52.744943 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e41be859-a450-444f-8f48-d937d0f6f908 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:52.753147 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-38fd7150-46e7-485a-9241-7bfd81b2b787 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:52.762029 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-38fd7150-46e7-485a-9241-7bfd81b2b787 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 200 len: 1318 microversion: 2.1 time: 0.255304 Nov 20 03:26:52.765078 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 244/413] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:52 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:52.954180 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-68030711-f96a-4001-8aa1-d138b1ee1480 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:52.955495 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-68030711-f96a-4001-8aa1-d138b1ee1480 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: 4111c671-ac86-42f4-8753-e38deb7c21a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:52.963555 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-68030711-f96a-4001-8aa1-d138b1ee1480 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:52.964320 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-68030711-f96a-4001-8aa1-d138b1ee1480 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:52.965338 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-68030711-f96a-4001-8aa1-d138b1ee1480 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:52.966420 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-68030711-f96a-4001-8aa1-d138b1ee1480 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:53.309331 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-e41be859-a450-444f-8f48-d937d0f6f908 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:53.319348 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-e41be859-a450-444f-8f48-d937d0f6f908 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1569 microversion: 2.1 time: 0.608163 Nov 20 03:26:53.321544 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 170/414] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:52 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1569 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:53.329825 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-5e738ec6-3b3c-4f3d-b298-84d43780f490 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:53.329990 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-5e738ec6-3b3c-4f3d-b298-84d43780f490 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:53.344256 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5e738ec6-3b3c-4f3d-b298-84d43780f490 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:53.344712 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5e738ec6-3b3c-4f3d-b298-84d43780f490 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:53.345507 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5e738ec6-3b3c-4f3d-b298-84d43780f490 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:53.355898 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5e738ec6-3b3c-4f3d-b298-84d43780f490 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:53.454574 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-68030711-f96a-4001-8aa1-d138b1ee1480 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:53.465677 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-68030711-f96a-4001-8aa1-d138b1ee1480 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0" status: 200 len: 1312 microversion: 2.1 time: 0.515036 Nov 20 03:26:53.466265 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 245/415] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:52 2021] GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0 => generated 1312 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:53.543382 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-5e738ec6-3b3c-4f3d-b298-84d43780f490 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:53.553254 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-5e738ec6-3b3c-4f3d-b298-84d43780f490 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:53.555081 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-5e738ec6-3b3c-4f3d-b298-84d43780f490 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:53.556391 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-5e738ec6-3b3c-4f3d-b298-84d43780f490 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1740 microversion: 2.20 time: 0.232258 Nov 20 03:26:53.557149 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 171/416] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:53 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1740 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:26:53.780196 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-edc11b98-f908-48ea-94d2-e414d32941b8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:53.780805 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-edc11b98-f908-48ea-94d2-e414d32941b8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:53.794528 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-edc11b98-f908-48ea-94d2-e414d32941b8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:53.794985 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-edc11b98-f908-48ea-94d2-e414d32941b8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:53.795778 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-edc11b98-f908-48ea-94d2-e414d32941b8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:53.796240 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-edc11b98-f908-48ea-94d2-e414d32941b8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:53.944394 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-edc11b98-f908-48ea-94d2-e414d32941b8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:53.952700 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-edc11b98-f908-48ea-94d2-e414d32941b8 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 200 len: 1318 microversion: 2.1 time: 0.176074 Nov 20 03:26:53.953420 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 246/417] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:53 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:54.338605 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-0edd0709-b07d-4d11-b90e-f71b8f2abd11 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:54.339221 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-0edd0709-b07d-4d11-b90e-f71b8f2abd11 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:54.346809 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0edd0709-b07d-4d11-b90e-f71b8f2abd11 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:54.347236 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0edd0709-b07d-4d11-b90e-f71b8f2abd11 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:54.348501 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0edd0709-b07d-4d11-b90e-f71b8f2abd11 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:54.349113 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0edd0709-b07d-4d11-b90e-f71b8f2abd11 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:54.482458 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-3a5f0941-fb66-4bec-97f8-c30905618776 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:54.483966 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-3a5f0941-fb66-4bec-97f8-c30905618776 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: 4111c671-ac86-42f4-8753-e38deb7c21a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:54.490831 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3a5f0941-fb66-4bec-97f8-c30905618776 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:54.491285 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3a5f0941-fb66-4bec-97f8-c30905618776 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:54.492090 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3a5f0941-fb66-4bec-97f8-c30905618776 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:54.492710 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3a5f0941-fb66-4bec-97f8-c30905618776 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:54.497860 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-0edd0709-b07d-4d11-b90e-f71b8f2abd11 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:54.506944 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-0edd0709-b07d-4d11-b90e-f71b8f2abd11 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1569 microversion: 2.1 time: 0.172379 Nov 20 03:26:54.509115 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 172/418] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:54 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:54.579091 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-eab08d19-b751-4015-8524-4ee552e56005 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:54.580152 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-eab08d19-b751-4015-8524-4ee552e56005 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:54.587011 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-eab08d19-b751-4015-8524-4ee552e56005 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:54.587477 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-eab08d19-b751-4015-8524-4ee552e56005 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:54.588321 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-eab08d19-b751-4015-8524-4ee552e56005 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:54.588854 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-eab08d19-b751-4015-8524-4ee552e56005 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:54.643985 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-3a5f0941-fb66-4bec-97f8-c30905618776 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:54.653835 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-3a5f0941-fb66-4bec-97f8-c30905618776 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0" status: 200 len: 1312 microversion: 2.1 time: 0.173114 Nov 20 03:26:54.654925 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 247/419] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:54 2021] GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0 => generated 1312 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:54.947411 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-eab08d19-b751-4015-8524-4ee552e56005 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:54.956800 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-eab08d19-b751-4015-8524-4ee552e56005 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:54.958326 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-eab08d19-b751-4015-8524-4ee552e56005 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:54.959519 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-eab08d19-b751-4015-8524-4ee552e56005 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1740 microversion: 2.20 time: 0.387618 Nov 20 03:26:54.960374 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 173/420] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:54 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1740 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:26:54.969636 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-7ea80790-b902-4dd8-9bea-d8f8071828a7 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:54.970344 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-7ea80790-b902-4dd8-9bea-d8f8071828a7 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:54.976722 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7ea80790-b902-4dd8-9bea-d8f8071828a7 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:54.977163 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7ea80790-b902-4dd8-9bea-d8f8071828a7 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:54.978013 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7ea80790-b902-4dd8-9bea-d8f8071828a7 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:54.978508 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7ea80790-b902-4dd8-9bea-d8f8071828a7 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:55.156122 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-7ea80790-b902-4dd8-9bea-d8f8071828a7 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:55.163685 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-7ea80790-b902-4dd8-9bea-d8f8071828a7 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 200 len: 1318 microversion: 2.1 time: 0.197897 Nov 20 03:26:55.164293 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 248/421] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:54 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:55.526404 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-e791f01b-cc25-4159-a62e-eb3b66a0eb3a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:55.528217 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-e791f01b-cc25-4159-a62e-eb3b66a0eb3a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:55.535201 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e791f01b-cc25-4159-a62e-eb3b66a0eb3a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:55.535853 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e791f01b-cc25-4159-a62e-eb3b66a0eb3a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:55.536643 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e791f01b-cc25-4159-a62e-eb3b66a0eb3a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:55.537267 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e791f01b-cc25-4159-a62e-eb3b66a0eb3a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:55.671347 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-c9760f6f-a42a-4fec-a0ee-08f2048dc13a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:55.674519 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-e791f01b-cc25-4159-a62e-eb3b66a0eb3a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:55.676862 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-c9760f6f-a42a-4fec-a0ee-08f2048dc13a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: 4111c671-ac86-42f4-8753-e38deb7c21a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:55.682880 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c9760f6f-a42a-4fec-a0ee-08f2048dc13a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:55.683062 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-e791f01b-cc25-4159-a62e-eb3b66a0eb3a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1569 microversion: 2.1 time: 0.160384 Nov 20 03:26:55.683707 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c9760f6f-a42a-4fec-a0ee-08f2048dc13a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:55.684777 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c9760f6f-a42a-4fec-a0ee-08f2048dc13a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:55.685219 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c9760f6f-a42a-4fec-a0ee-08f2048dc13a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:55.693237 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 174/422] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:55 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:55.831567 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-c9760f6f-a42a-4fec-a0ee-08f2048dc13a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:55.839244 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-c9760f6f-a42a-4fec-a0ee-08f2048dc13a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0" status: 200 len: 1312 microversion: 2.1 time: 0.172199 Nov 20 03:26:55.840329 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 249/423] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:55 2021] GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0 => generated 1312 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:55.977940 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-6b56499e-19b3-4f42-bdfb-6fe6e40723e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:55.978542 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-6b56499e-19b3-4f42-bdfb-6fe6e40723e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:55.984443 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6b56499e-19b3-4f42-bdfb-6fe6e40723e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:55.984889 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6b56499e-19b3-4f42-bdfb-6fe6e40723e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:55.985664 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6b56499e-19b3-4f42-bdfb-6fe6e40723e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:55.986127 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6b56499e-19b3-4f42-bdfb-6fe6e40723e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:56.115534 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-6b56499e-19b3-4f42-bdfb-6fe6e40723e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:56.123173 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-6b56499e-19b3-4f42-bdfb-6fe6e40723e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:56.124699 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-6b56499e-19b3-4f42-bdfb-6fe6e40723e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:56.125837 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-6b56499e-19b3-4f42-bdfb-6fe6e40723e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1740 microversion: 2.20 time: 0.151598 Nov 20 03:26:56.126383 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 175/424] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:55 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1740 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:26:56.183303 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-53960dc2-10e1-4cdd-9cfc-cc8e3ad67119 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:56.183950 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-53960dc2-10e1-4cdd-9cfc-cc8e3ad67119 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:56.190030 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-53960dc2-10e1-4cdd-9cfc-cc8e3ad67119 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:56.190485 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-53960dc2-10e1-4cdd-9cfc-cc8e3ad67119 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:56.191265 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-53960dc2-10e1-4cdd-9cfc-cc8e3ad67119 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:56.191697 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-53960dc2-10e1-4cdd-9cfc-cc8e3ad67119 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:56.434503 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-53960dc2-10e1-4cdd-9cfc-cc8e3ad67119 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:56.442202 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-53960dc2-10e1-4cdd-9cfc-cc8e3ad67119 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 200 len: 1318 microversion: 2.1 time: 0.263258 Nov 20 03:26:56.452578 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 250/425] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:56 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:56.699190 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-57e6ec6c-439e-4653-9bc8-8ce6856e0771 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:56.699734 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-57e6ec6c-439e-4653-9bc8-8ce6856e0771 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:56.706038 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-57e6ec6c-439e-4653-9bc8-8ce6856e0771 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:56.706481 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-57e6ec6c-439e-4653-9bc8-8ce6856e0771 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:56.707253 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-57e6ec6c-439e-4653-9bc8-8ce6856e0771 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:56.707686 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-57e6ec6c-439e-4653-9bc8-8ce6856e0771 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:56.836683 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-57e6ec6c-439e-4653-9bc8-8ce6856e0771 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:56.844263 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-57e6ec6c-439e-4653-9bc8-8ce6856e0771 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1569 microversion: 2.1 time: 0.148809 Nov 20 03:26:56.844824 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 176/426] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:56 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:56.856832 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-16920e42-e204-4d47-84f8-6e3afacd4043 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:56.857435 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-16920e42-e204-4d47-84f8-6e3afacd4043 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: 4111c671-ac86-42f4-8753-e38deb7c21a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:56.863549 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-16920e42-e204-4d47-84f8-6e3afacd4043 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:56.864030 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-16920e42-e204-4d47-84f8-6e3afacd4043 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:56.864795 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-16920e42-e204-4d47-84f8-6e3afacd4043 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:56.865219 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-16920e42-e204-4d47-84f8-6e3afacd4043 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:57.000662 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-16920e42-e204-4d47-84f8-6e3afacd4043 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:57.008557 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-16920e42-e204-4d47-84f8-6e3afacd4043 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0" status: 200 len: 1312 microversion: 2.1 time: 0.155828 Nov 20 03:26:57.009138 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 251/427] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:56 2021] GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0 => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:57.144929 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-060e04c8-3d12-4a7d-9b3d-35aca526bbfa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:57.145538 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-060e04c8-3d12-4a7d-9b3d-35aca526bbfa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:57.151373 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-060e04c8-3d12-4a7d-9b3d-35aca526bbfa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:57.151844 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-060e04c8-3d12-4a7d-9b3d-35aca526bbfa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:57.153103 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-060e04c8-3d12-4a7d-9b3d-35aca526bbfa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:57.153538 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-060e04c8-3d12-4a7d-9b3d-35aca526bbfa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:57.333286 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-060e04c8-3d12-4a7d-9b3d-35aca526bbfa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:57.341578 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-060e04c8-3d12-4a7d-9b3d-35aca526bbfa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:57.343089 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-060e04c8-3d12-4a7d-9b3d-35aca526bbfa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:57.344285 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-060e04c8-3d12-4a7d-9b3d-35aca526bbfa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1722 microversion: 2.20 time: 0.203136 Nov 20 03:26:57.344837 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 177/428] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:57 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:26:57.460277 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-690b7b00-ba6d-49c2-8837-a7c4defae73b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:57.461034 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-690b7b00-ba6d-49c2-8837-a7c4defae73b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:57.467881 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-690b7b00-ba6d-49c2-8837-a7c4defae73b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:57.468413 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-690b7b00-ba6d-49c2-8837-a7c4defae73b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:57.469412 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-690b7b00-ba6d-49c2-8837-a7c4defae73b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:57.469851 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-690b7b00-ba6d-49c2-8837-a7c4defae73b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:57.654266 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-690b7b00-ba6d-49c2-8837-a7c4defae73b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:57.661511 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-690b7b00-ba6d-49c2-8837-a7c4defae73b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 200 len: 1318 microversion: 2.1 time: 0.205388 Nov 20 03:26:57.662082 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 252/429] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:57 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:57.861921 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-d57f956a-5a53-4cb9-99c0-111626e6a1f7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:57.862534 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-d57f956a-5a53-4cb9-99c0-111626e6a1f7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:57.868866 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d57f956a-5a53-4cb9-99c0-111626e6a1f7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:57.869319 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d57f956a-5a53-4cb9-99c0-111626e6a1f7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:57.870098 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d57f956a-5a53-4cb9-99c0-111626e6a1f7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:57.870534 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d57f956a-5a53-4cb9-99c0-111626e6a1f7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:57.998281 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-d57f956a-5a53-4cb9-99c0-111626e6a1f7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:58.006185 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-d57f956a-5a53-4cb9-99c0-111626e6a1f7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1569 microversion: 2.1 time: 0.147925 Nov 20 03:26:58.006747 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 178/430] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:57 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:58.026144 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-c5345606-570e-40be-a4a2-f34307b2be20 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:58.026756 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-c5345606-570e-40be-a4a2-f34307b2be20 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: 4111c671-ac86-42f4-8753-e38deb7c21a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:58.033073 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c5345606-570e-40be-a4a2-f34307b2be20 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:58.033599 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c5345606-570e-40be-a4a2-f34307b2be20 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:58.034369 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c5345606-570e-40be-a4a2-f34307b2be20 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:58.034797 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c5345606-570e-40be-a4a2-f34307b2be20 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:58.162627 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-c5345606-570e-40be-a4a2-f34307b2be20 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:58.170393 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-c5345606-570e-40be-a4a2-f34307b2be20 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0" status: 200 len: 1312 microversion: 2.1 time: 0.148983 Nov 20 03:26:58.170980 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 253/431] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:58 2021] GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0 => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:58.362322 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-42330977-680a-4703-a33d-89f5f4ae45e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:58.363166 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-42330977-680a-4703-a33d-89f5f4ae45e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:58.368850 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-42330977-680a-4703-a33d-89f5f4ae45e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:58.369302 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-42330977-680a-4703-a33d-89f5f4ae45e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:58.370086 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-42330977-680a-4703-a33d-89f5f4ae45e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:58.370529 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-42330977-680a-4703-a33d-89f5f4ae45e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:58.504668 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-42330977-680a-4703-a33d-89f5f4ae45e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:58.513417 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-42330977-680a-4703-a33d-89f5f4ae45e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:58.515281 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-42330977-680a-4703-a33d-89f5f4ae45e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:58.516492 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-42330977-680a-4703-a33d-89f5f4ae45e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1722 microversion: 2.20 time: 0.157943 Nov 20 03:26:58.517054 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 179/432] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:58 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:26:58.607267 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-2f8e7f71-3de6-4a92-b7ca-1f0446c1512f req-5254d681-3d4f-421e-836a-a00f8c7ef83d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4111c671-ac86-42f4-8753-e38deb7c21a0", "name": "network-vif-plugged", "status": "completed", "tag": "0af31e15-9931-4f34-8890-97b152868a29"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:26:58.608868 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:26:58.608868 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:26:58.616084 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-2f8e7f71-3de6-4a92-b7ca-1f0446c1512f req-5254d681-3d4f-421e-836a-a00f8c7ef83d service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:58.616531 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-2f8e7f71-3de6-4a92-b7ca-1f0446c1512f req-5254d681-3d4f-421e-836a-a00f8c7ef83d service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:58.628089 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-2f8e7f71-3de6-4a92-b7ca-1f0446c1512f req-5254d681-3d4f-421e-836a-a00f8c7ef83d service nova] Creating event network-vif-plugged:0af31e15-9931-4f34-8890-97b152868a29 for instance 4111c671-ac86-42f4-8753-e38deb7c21a0 on hv-cinder-81803 Nov 20 03:26:58.632738 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-2f8e7f71-3de6-4a92-b7ca-1f0446c1512f req-5254d681-3d4f-421e-836a-a00f8c7ef83d service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029068 Nov 20 03:26:58.633486 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 254/433] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:26:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:26:58.678257 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-fedc0ba9-6f12-469c-811e-669e76f7e115 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:58.678870 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-fedc0ba9-6f12-469c-811e-669e76f7e115 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:58.685542 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fedc0ba9-6f12-469c-811e-669e76f7e115 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:58.686230 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fedc0ba9-6f12-469c-811e-669e76f7e115 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:58.687250 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fedc0ba9-6f12-469c-811e-669e76f7e115 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:58.687692 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fedc0ba9-6f12-469c-811e-669e76f7e115 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:58.820780 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-fedc0ba9-6f12-469c-811e-669e76f7e115 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:58.828721 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-fedc0ba9-6f12-469c-811e-669e76f7e115 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 200 len: 1318 microversion: 2.1 time: 0.154102 Nov 20 03:26:58.829307 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 180/434] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:58 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:59.023242 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-04e755bc-69cc-4ac8-8c7b-dfaaeacf3964 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:59.023966 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-04e755bc-69cc-4ac8-8c7b-dfaaeacf3964 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:59.030609 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-04e755bc-69cc-4ac8-8c7b-dfaaeacf3964 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:59.031185 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-04e755bc-69cc-4ac8-8c7b-dfaaeacf3964 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:59.031810 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-04e755bc-69cc-4ac8-8c7b-dfaaeacf3964 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:59.032266 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-04e755bc-69cc-4ac8-8c7b-dfaaeacf3964 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:59.171898 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-04e755bc-69cc-4ac8-8c7b-dfaaeacf3964 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:59.179959 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-04e755bc-69cc-4ac8-8c7b-dfaaeacf3964 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1569 microversion: 2.1 time: 0.160608 Nov 20 03:26:59.180554 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 255/435] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:59 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:26:59.189676 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-b6a1b644-5989-4172-a38f-ad3bc3f03ec7 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:59.191474 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-b6a1b644-5989-4172-a38f-ad3bc3f03ec7 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: 4111c671-ac86-42f4-8753-e38deb7c21a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:59.198012 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b6a1b644-5989-4172-a38f-ad3bc3f03ec7 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:59.198514 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b6a1b644-5989-4172-a38f-ad3bc3f03ec7 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:59.199378 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b6a1b644-5989-4172-a38f-ad3bc3f03ec7 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:59.200586 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b6a1b644-5989-4172-a38f-ad3bc3f03ec7 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:59.338898 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-b6a1b644-5989-4172-a38f-ad3bc3f03ec7 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:59.347333 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-b6a1b644-5989-4172-a38f-ad3bc3f03ec7 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0" status: 200 len: 1312 microversion: 2.1 time: 0.163935 Nov 20 03:26:59.348411 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 181/436] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:59 2021] GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0 => generated 1312 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:26:59.534978 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-321b55ad-7c33-46fd-aadb-69e449946c11 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:59.535488 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-321b55ad-7c33-46fd-aadb-69e449946c11 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:59.541337 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-321b55ad-7c33-46fd-aadb-69e449946c11 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:59.541793 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-321b55ad-7c33-46fd-aadb-69e449946c11 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:59.542565 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-321b55ad-7c33-46fd-aadb-69e449946c11 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:59.543639 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-321b55ad-7c33-46fd-aadb-69e449946c11 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:59.671056 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-321b55ad-7c33-46fd-aadb-69e449946c11 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:59.679079 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-321b55ad-7c33-46fd-aadb-69e449946c11 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:59.680640 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-321b55ad-7c33-46fd-aadb-69e449946c11 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:59.681783 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-321b55ad-7c33-46fd-aadb-69e449946c11 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1722 microversion: 2.20 time: 0.150686 Nov 20 03:26:59.682337 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 256/437] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:26:59 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:26:59.845371 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-e30ff656-a3f0-4aa9-bb72-8b04feda05e6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:26:59.845925 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-e30ff656-a3f0-4aa9-bb72-8b04feda05e6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:26:59.852063 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e30ff656-a3f0-4aa9-bb72-8b04feda05e6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:59.852515 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e30ff656-a3f0-4aa9-bb72-8b04feda05e6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:59.853278 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e30ff656-a3f0-4aa9-bb72-8b04feda05e6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:26:59.853706 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e30ff656-a3f0-4aa9-bb72-8b04feda05e6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:26:59.981961 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-e30ff656-a3f0-4aa9-bb72-8b04feda05e6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:26:59.989103 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-e30ff656-a3f0-4aa9-bb72-8b04feda05e6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 200 len: 1318 microversion: 2.1 time: 0.147473 Nov 20 03:26:59.989654 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 182/438] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:26:59 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:00.204644 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-2d86cb0e-0afa-4490-b512-2af4e8b49938 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:00.205254 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-2d86cb0e-0afa-4490-b512-2af4e8b49938 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:00.214853 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2d86cb0e-0afa-4490-b512-2af4e8b49938 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:00.215302 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2d86cb0e-0afa-4490-b512-2af4e8b49938 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:00.216135 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2d86cb0e-0afa-4490-b512-2af4e8b49938 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:00.216589 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2d86cb0e-0afa-4490-b512-2af4e8b49938 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:00.321125 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-6c3b79a1-56c2-4568-895d-4b3e6732029b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-609488325", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2111923564", "security_groups": [{"name": "tempest-secgroup-smoke-1311371933"}], "block_device_mapping_v2": [{"uuid": "fad1466b-e92d-4e67-9883-ef8d80041feb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "47f51dd2-9655-4765-8747-cb254c8e5525"}]}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:27:00.354280 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-2d86cb0e-0afa-4490-b512-2af4e8b49938 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:00.364677 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-2d86cb0e-0afa-4490-b512-2af4e8b49938 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1569 microversion: 2.1 time: 0.163506 Nov 20 03:27:00.365552 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 257/439] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:00 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:00.370261 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-9310b5da-4acb-4c93-8d50-678321f80c17 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:00.371394 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-9310b5da-4acb-4c93-8d50-678321f80c17 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: 4111c671-ac86-42f4-8753-e38deb7c21a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:00.377522 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9310b5da-4acb-4c93-8d50-678321f80c17 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:00.378150 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9310b5da-4acb-4c93-8d50-678321f80c17 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:00.378926 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9310b5da-4acb-4c93-8d50-678321f80c17 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:00.379519 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9310b5da-4acb-4c93-8d50-678321f80c17 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:00.473597 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.network.neutron [None req-6c3b79a1-56c2-4568-895d-4b3e6732029b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] validate_networks() for [('47f51dd2-9655-4765-8747-cb254c8e5525', None, None, None, None, None)] {{(pid=116114) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 03:27:00.591282 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9310b5da-4acb-4c93-8d50-678321f80c17 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:00.598921 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-9310b5da-4acb-4c93-8d50-678321f80c17 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0" status: 200 len: 1312 microversion: 2.1 time: 0.232145 Nov 20 03:27:00.599694 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 258/440] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:00 2021] GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0 => generated 1312 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:00.648103 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-74b7e13f-af94-476d-b826-cde0b7a3b8b6 req-c64d6a4a-bdf5-4abe-b142-3b664d4f7538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f68eb618-c745-43db-a873-7c0700c0f11c", "name": "network-vif-unplugged", "status": "completed", "tag": "7a19e0fe-867b-45fc-9ef7-f883f1a8dbd9"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:27:00.650054 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:27:00.650054 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:27:00.658577 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-74b7e13f-af94-476d-b826-cde0b7a3b8b6 req-c64d6a4a-bdf5-4abe-b142-3b664d4f7538 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:00.659028 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-74b7e13f-af94-476d-b826-cde0b7a3b8b6 req-c64d6a4a-bdf5-4abe-b142-3b664d4f7538 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:00.671489 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-74b7e13f-af94-476d-b826-cde0b7a3b8b6 req-c64d6a4a-bdf5-4abe-b142-3b664d4f7538 service nova] Creating event network-vif-unplugged:7a19e0fe-867b-45fc-9ef7-f883f1a8dbd9 for instance f68eb618-c745-43db-a873-7c0700c0f11c on hv-cinder-81803 Nov 20 03:27:00.676985 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-74b7e13f-af94-476d-b826-cde0b7a3b8b6 req-c64d6a4a-bdf5-4abe-b142-3b664d4f7538 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032868 Nov 20 03:27:00.677840 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 259/441] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:27:00 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:27:00.701002 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-8460cb04-b58b-4c2d-83c3-8aa2f14a150e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:00.701789 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-8460cb04-b58b-4c2d-83c3-8aa2f14a150e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:00.711846 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8460cb04-b58b-4c2d-83c3-8aa2f14a150e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:00.711846 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8460cb04-b58b-4c2d-83c3-8aa2f14a150e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:00.711846 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8460cb04-b58b-4c2d-83c3-8aa2f14a150e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:00.711846 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8460cb04-b58b-4c2d-83c3-8aa2f14a150e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:00.934040 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-8460cb04-b58b-4c2d-83c3-8aa2f14a150e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:00.944600 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-8460cb04-b58b-4c2d-83c3-8aa2f14a150e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:00.946675 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-8460cb04-b58b-4c2d-83c3-8aa2f14a150e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:00.948231 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-8460cb04-b58b-4c2d-83c3-8aa2f14a150e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1722 microversion: 2.20 time: 0.251908 Nov 20 03:27:00.950654 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 260/442] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:00 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:27:00.977266 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-6c3b79a1-56c2-4568-895d-4b3e6732029b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Flavor limits 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 03:27:00.977686 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-6c3b79a1-56c2-4568-895d-4b3e6732029b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Image limits 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 03:27:00.978368 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-6c3b79a1-56c2-4568-895d-4b3e6732029b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Flavor pref 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 03:27:00.978779 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-6c3b79a1-56c2-4568-895d-4b3e6732029b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Image pref 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 03:27:00.979189 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-6c3b79a1-56c2-4568-895d-4b3e6732029b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 03:27:00.989229 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6c3b79a1-56c2-4568-895d-4b3e6732029b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:00.989727 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6c3b79a1-56c2-4568-895d-4b3e6732029b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:00.990675 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6c3b79a1-56c2-4568-895d-4b3e6732029b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:00.990974 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6c3b79a1-56c2-4568-895d-4b3e6732029b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:01.007735 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-cecd0629-11e5-4aa7-bdc4-6adebf9d3746 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:01.008394 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-cecd0629-11e5-4aa7-bdc4-6adebf9d3746 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:01.014821 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cecd0629-11e5-4aa7-bdc4-6adebf9d3746 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:01.015268 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cecd0629-11e5-4aa7-bdc4-6adebf9d3746 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:01.016119 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cecd0629-11e5-4aa7-bdc4-6adebf9d3746 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:01.016557 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cecd0629-11e5-4aa7-bdc4-6adebf9d3746 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:01.019140 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-6c3b79a1-56c2-4568-895d-4b3e6732029b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Getting quotas for project ee28f54d912d4789b1b0abf0f0cddab5. Resources: {'ram', 'cores', 'instances'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:27:01.023873 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-6c3b79a1-56c2-4568-895d-4b3e6732029b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Getting quotas for user 2841384d235c4869bc6c39212c34f0f9 and project ee28f54d912d4789b1b0abf0f0cddab5. Resources: {'ram', 'cores', 'instances'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:27:01.089321 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-6c3b79a1-56c2-4568-895d-4b3e6732029b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Going to run 1 instances... {{(pid=116114) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 03:27:01.091579 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-6c3b79a1-56c2-4568-895d-4b3e6732029b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fad1466b-e92d-4e67-9883-ef8d80041feb',volume_size=None,volume_type=None)] {{(pid=116114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 03:27:01.169561 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-cecd0629-11e5-4aa7-bdc4-6adebf9d3746 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:01.179510 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-cecd0629-11e5-4aa7-bdc4-6adebf9d3746 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 200 len: 1318 microversion: 2.1 time: 0.175629 Nov 20 03:27:01.187871 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 261/443] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:01 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:01.233063 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-6c3b79a1-56c2-4568-895d-4b3e6732029b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.915515 Nov 20 03:27:01.233703 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 183/444] 10.222.0.37 () {60 vars in 1146 bytes} [Sat Nov 20 03:27:00 2021] POST /compute/v2.1/servers => generated 406 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 03:27:01.243463 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-8e63be91-b322-4748-8e4f-eaeff2a6d9bc tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:01.244110 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-8e63be91-b322-4748-8e4f-eaeff2a6d9bc tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:01.309920 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-8e63be91-b322-4748-8e4f-eaeff2a6d9bc tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:01.317849 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-8e63be91-b322-4748-8e4f-eaeff2a6d9bc tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1094 microversion: 2.1 time: 0.077867 Nov 20 03:27:01.319182 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 262/445] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:01 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1094 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:01.385358 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-4a524dd3-d58a-4330-b30a-5cd0c39e05ce tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:01.385990 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-4a524dd3-d58a-4330-b30a-5cd0c39e05ce tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:01.399479 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4a524dd3-d58a-4330-b30a-5cd0c39e05ce tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:01.399986 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4a524dd3-d58a-4330-b30a-5cd0c39e05ce tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:01.400786 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4a524dd3-d58a-4330-b30a-5cd0c39e05ce tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:01.401242 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4a524dd3-d58a-4330-b30a-5cd0c39e05ce tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:01.545789 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-4a524dd3-d58a-4330-b30a-5cd0c39e05ce tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:01.554445 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-4a524dd3-d58a-4330-b30a-5cd0c39e05ce tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1549 microversion: 2.1 time: 0.175403 Nov 20 03:27:01.555094 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 184/446] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:01 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1549 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:01.573237 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-1947af7a-4cdb-436a-a41c-07d501115b41 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:01.575515 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-1947af7a-4cdb-436a-a41c-07d501115b41 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:01.582684 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1947af7a-4cdb-436a-a41c-07d501115b41 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:01.584232 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1947af7a-4cdb-436a-a41c-07d501115b41 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:01.585172 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1947af7a-4cdb-436a-a41c-07d501115b41 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:01.586180 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1947af7a-4cdb-436a-a41c-07d501115b41 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:01.615908 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-6c4ed65b-f8fb-4da3-84c8-5c85b4ab485b tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:01.617052 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-6c4ed65b-f8fb-4da3-84c8-5c85b4ab485b tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: 4111c671-ac86-42f4-8753-e38deb7c21a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:01.626443 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6c4ed65b-f8fb-4da3-84c8-5c85b4ab485b tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:01.626963 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6c4ed65b-f8fb-4da3-84c8-5c85b4ab485b tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:01.628175 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6c4ed65b-f8fb-4da3-84c8-5c85b4ab485b tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:01.628892 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6c4ed65b-f8fb-4da3-84c8-5c85b4ab485b tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:01.680115 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.wsgi [None req-1947af7a-4cdb-436a-a41c-07d501115b41 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] HTTP exception thrown: Cannot 'detach_volume' instance 1520eab8-d6b9-48aa-8333-5c7758310e82 while it is in vm_state rescued Nov 20 03:27:01.680893 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-1947af7a-4cdb-436a-a41c-07d501115b41 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Returning 409 to user: Cannot 'detach_volume' instance 1520eab8-d6b9-48aa-8333-5c7758310e82 while it is in vm_state rescued {{(pid=116113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:27:01.682529 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-1947af7a-4cdb-436a-a41c-07d501115b41 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "DELETE /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments/11593169-ca31-4702-b62b-5f4fd37cb698" status: 409 len: 152 microversion: 2.1 time: 0.113249 Nov 20 03:27:01.684114 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 263/447] 10.222.0.37 () {58 vars in 1415 bytes} [Sat Nov 20 03:27:01 2021] DELETE /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments/11593169-ca31-4702-b62b-5f4fd37cb698 => generated 152 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 20 03:27:01.692287 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-c7cf3b66-c9f8-42ec-81e2-115db61ce66b tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:27:01.692875 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-c7cf3b66-c9f8-42ec-81e2-115db61ce66b tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:01.702331 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c7cf3b66-c9f8-42ec-81e2-115db61ce66b tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:01.703065 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c7cf3b66-c9f8-42ec-81e2-115db61ce66b tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:01.704446 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c7cf3b66-c9f8-42ec-81e2-115db61ce66b tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:01.705099 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c7cf3b66-c9f8-42ec-81e2-115db61ce66b tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:01.799202 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-c7cf3b66-c9f8-42ec-81e2-115db61ce66b tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "POST /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/action" status: 202 len: 0 microversion: 2.1 time: 0.110873 Nov 20 03:27:01.804721 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 264/448] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:27:01 2021] POST /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 03:27:01.814522 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-1ab3f1c6-8ea9-4730-adb3-32e6cda3ace7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:01.815382 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-1ab3f1c6-8ea9-4730-adb3-32e6cda3ace7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:01.816220 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-6c4ed65b-f8fb-4da3-84c8-5c85b4ab485b tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:01.823926 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1ab3f1c6-8ea9-4730-adb3-32e6cda3ace7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:01.825501 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-6c4ed65b-f8fb-4da3-84c8-5c85b4ab485b tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0" status: 200 len: 1496 microversion: 2.1 time: 0.213817 Nov 20 03:27:01.825944 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1ab3f1c6-8ea9-4730-adb3-32e6cda3ace7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:01.826069 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 185/449] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:01 2021] GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0 => generated 1496 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:01.827596 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1ab3f1c6-8ea9-4730-adb3-32e6cda3ace7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:01.828074 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1ab3f1c6-8ea9-4730-adb3-32e6cda3ace7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:01.968184 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-2b1d72f3-bbbb-46b2-af5b-49830c54fee1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:01.968796 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-2b1d72f3-bbbb-46b2-af5b-49830c54fee1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:01.975951 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2b1d72f3-bbbb-46b2-af5b-49830c54fee1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:01.976406 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2b1d72f3-bbbb-46b2-af5b-49830c54fee1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:01.977196 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2b1d72f3-bbbb-46b2-af5b-49830c54fee1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:01.977631 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2b1d72f3-bbbb-46b2-af5b-49830c54fee1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:02.077143 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-1ab3f1c6-8ea9-4730-adb3-32e6cda3ace7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:02.087673 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-1ab3f1c6-8ea9-4730-adb3-32e6cda3ace7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1557 microversion: 2.1 time: 0.280750 Nov 20 03:27:02.101807 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 265/450] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:01 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1557 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:02.197242 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-a678233a-de00-4c43-a49a-a1629ef430b1 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:02.198701 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-a678233a-de00-4c43-a49a-a1629ef430b1 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:02.204880 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a678233a-de00-4c43-a49a-a1629ef430b1 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:02.205326 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a678233a-de00-4c43-a49a-a1629ef430b1 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:02.206727 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a678233a-de00-4c43-a49a-a1629ef430b1 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:02.207167 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a678233a-de00-4c43-a49a-a1629ef430b1 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:02.237446 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-2b1d72f3-bbbb-46b2-af5b-49830c54fee1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:02.249777 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-2b1d72f3-bbbb-46b2-af5b-49830c54fee1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:02.251286 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-2b1d72f3-bbbb-46b2-af5b-49830c54fee1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:02.252823 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-2b1d72f3-bbbb-46b2-af5b-49830c54fee1 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1665 microversion: 2.20 time: 0.288238 Nov 20 03:27:02.253863 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 186/451] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:01 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1665 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:27:02.272074 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-c39f98f3-ec18-4cd1-8175-6be31dc19ced tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b1c693b-712c-4c08-838b-5001ed49f328"}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:27:02.273394 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-c39f98f3-ec18-4cd1-8175-6be31dc19ced tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:02.280635 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c39f98f3-ec18-4cd1-8175-6be31dc19ced tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:02.281285 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c39f98f3-ec18-4cd1-8175-6be31dc19ced tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:02.282325 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c39f98f3-ec18-4cd1-8175-6be31dc19ced tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:02.283163 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c39f98f3-ec18-4cd1-8175-6be31dc19ced tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:02.501075 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a678233a-de00-4c43-a49a-a1629ef430b1 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:02.526876 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-a678233a-de00-4c43-a49a-a1629ef430b1 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 200 len: 1318 microversion: 2.1 time: 0.319219 Nov 20 03:27:02.529800 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 266/452] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:02 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:02.540941 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ddbdd93e-1b01-4d09-9a6b-3e7964bbe492 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:02.541939 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ddbdd93e-1b01-4d09-9a6b-3e7964bbe492 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:02.551162 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ddbdd93e-1b01-4d09-9a6b-3e7964bbe492 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:02.552711 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ddbdd93e-1b01-4d09-9a6b-3e7964bbe492 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:02.559086 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ddbdd93e-1b01-4d09-9a6b-3e7964bbe492 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:02.563452 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ddbdd93e-1b01-4d09-9a6b-3e7964bbe492 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:02.749510 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-ddbdd93e-1b01-4d09-9a6b-3e7964bbe492 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:02.759330 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ddbdd93e-1b01-4d09-9a6b-3e7964bbe492 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1192 microversion: 2.1 time: 0.228191 Nov 20 03:27:02.760988 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 267/453] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:02 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1192 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:02.766767 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-e5558219-58e9-4113-8957-bb71487c3ad4 req-2cbc019f-b733-4ded-981e-24261f9e385f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36116e65-2e67-4d18-84c2-d699cae54285", "name": "network-vif-plugged", "status": "completed", "tag": "502d5837-eaef-4602-9057-cc1f1bb18eb2"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:27:02.768671 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:27:02.768671 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:27:02.776655 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-e5558219-58e9-4113-8957-bb71487c3ad4 req-2cbc019f-b733-4ded-981e-24261f9e385f service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:02.777804 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-e5558219-58e9-4113-8957-bb71487c3ad4 req-2cbc019f-b733-4ded-981e-24261f9e385f service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:02.789821 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-e5558219-58e9-4113-8957-bb71487c3ad4 req-2cbc019f-b733-4ded-981e-24261f9e385f service nova] Creating event network-vif-plugged:502d5837-eaef-4602-9057-cc1f1bb18eb2 for instance 36116e65-2e67-4d18-84c2-d699cae54285 on hv-cinder-81803 Nov 20 03:27:02.796319 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-e5558219-58e9-4113-8957-bb71487c3ad4 req-2cbc019f-b733-4ded-981e-24261f9e385f service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033280 Nov 20 03:27:02.797215 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 268/454] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:27:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:27:02.811349 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-c39f98f3-ec18-4cd1-8175-6be31dc19ced tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.543004 Nov 20 03:27:02.813866 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 187/455] 10.222.0.37 () {62 vars in 1363 bytes} [Sat Nov 20 03:27:02 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/os-volume_attachments => generated 188 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 03:27:02.814924 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-720b9a7b-49b9-4b0d-9873-5c6ae1977bef tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:02.816624 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-720b9a7b-49b9-4b0d-9873-5c6ae1977bef tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: 4111c671-ac86-42f4-8753-e38deb7c21a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:02.823122 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-720b9a7b-49b9-4b0d-9873-5c6ae1977bef tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:02.824502 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-720b9a7b-49b9-4b0d-9873-5c6ae1977bef tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:02.825674 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-720b9a7b-49b9-4b0d-9873-5c6ae1977bef tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:02.826256 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-720b9a7b-49b9-4b0d-9873-5c6ae1977bef tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:02.854602 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-720b9a7b-49b9-4b0d-9873-5c6ae1977bef tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: 4111c671-ac86-42f4-8753-e38deb7c21a0] Going to try to terminate instance {{(pid=116113) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 03:27:02.957008 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-720b9a7b-49b9-4b0d-9873-5c6ae1977bef tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "DELETE /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0" status: 204 len: 0 microversion: 2.1 time: 0.157464 Nov 20 03:27:02.957886 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 269/456] 10.222.0.37 () {58 vars in 1238 bytes} [Sat Nov 20 03:27:02 2021] DELETE /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 03:27:02.965199 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-97cfa94d-2962-4965-b7e3-35946c717c35 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:27:02.965889 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-97cfa94d-2962-4965-b7e3-35946c717c35 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:02.969622 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-6ab3ced2-8a0a-4764-b617-9f2e909e3b2a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:02.970320 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-6ab3ced2-8a0a-4764-b617-9f2e909e3b2a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: 4111c671-ac86-42f4-8753-e38deb7c21a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:02.974110 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-97cfa94d-2962-4965-b7e3-35946c717c35 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:02.976150 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-97cfa94d-2962-4965-b7e3-35946c717c35 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:02.977091 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-97cfa94d-2962-4965-b7e3-35946c717c35 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:02.977218 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6ab3ced2-8a0a-4764-b617-9f2e909e3b2a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:02.977812 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6ab3ced2-8a0a-4764-b617-9f2e909e3b2a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:02.978634 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6ab3ced2-8a0a-4764-b617-9f2e909e3b2a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:02.979073 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6ab3ced2-8a0a-4764-b617-9f2e909e3b2a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:02.981725 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-97cfa94d-2962-4965-b7e3-35946c717c35 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:03.132905 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-97cfa94d-2962-4965-b7e3-35946c717c35 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action" status: 202 len: 0 microversion: 2.20 time: 0.171724 Nov 20 03:27:03.133979 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 188/457] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:27:02 2021] POST /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 20 03:27:03.139285 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-caefbe0e-6b0d-4a32-8615-a0510db632fd tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:03.139942 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-caefbe0e-6b0d-4a32-8615-a0510db632fd tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:03.146020 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-caefbe0e-6b0d-4a32-8615-a0510db632fd tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:03.147074 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-caefbe0e-6b0d-4a32-8615-a0510db632fd tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:03.147264 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-caefbe0e-6b0d-4a32-8615-a0510db632fd tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:03.147704 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-caefbe0e-6b0d-4a32-8615-a0510db632fd tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:03.179548 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-6ab3ced2-8a0a-4764-b617-9f2e909e3b2a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:03.189066 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-6ab3ced2-8a0a-4764-b617-9f2e909e3b2a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0" status: 200 len: 1502 microversion: 2.1 time: 0.223935 Nov 20 03:27:03.190079 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 270/458] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:02 2021] GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0 => generated 1502 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:03.204254 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-a51b7367-4752-40f3-9a6a-877ac16d1a70 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:03.204859 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-a51b7367-4752-40f3-9a6a-877ac16d1a70 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:03.210641 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a51b7367-4752-40f3-9a6a-877ac16d1a70 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:03.211088 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a51b7367-4752-40f3-9a6a-877ac16d1a70 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:03.211891 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a51b7367-4752-40f3-9a6a-877ac16d1a70 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:03.212325 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a51b7367-4752-40f3-9a6a-877ac16d1a70 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:03.315729 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-caefbe0e-6b0d-4a32-8615-a0510db632fd tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:03.325228 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-caefbe0e-6b0d-4a32-8615-a0510db632fd tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1557 microversion: 2.1 time: 0.190242 Nov 20 03:27:03.325896 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 189/459] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:03 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1557 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:03.380163 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a51b7367-4752-40f3-9a6a-877ac16d1a70 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:03.388445 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a51b7367-4752-40f3-9a6a-877ac16d1a70 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:03.389973 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a51b7367-4752-40f3-9a6a-877ac16d1a70 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:03.391119 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-a51b7367-4752-40f3-9a6a-877ac16d1a70 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1751 microversion: 2.20 time: 0.191115 Nov 20 03:27:03.391669 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 271/460] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:03 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1751 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:27:03.546978 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-c6892219-2fd8-4dc2-94f0-919678d8e3c6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:03.547592 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-c6892219-2fd8-4dc2-94f0-919678d8e3c6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:03.553678 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c6892219-2fd8-4dc2-94f0-919678d8e3c6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:03.554125 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c6892219-2fd8-4dc2-94f0-919678d8e3c6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:03.554903 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c6892219-2fd8-4dc2-94f0-919678d8e3c6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:03.555338 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c6892219-2fd8-4dc2-94f0-919678d8e3c6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:03.686555 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-c6892219-2fd8-4dc2-94f0-919678d8e3c6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:03.693799 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-c6892219-2fd8-4dc2-94f0-919678d8e3c6 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 200 len: 1318 microversion: 2.1 time: 0.150799 Nov 20 03:27:03.694262 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 190/461] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:03 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:03.777149 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-8a101452-ffa4-419a-875f-358279946733 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:03.778282 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-8a101452-ffa4-419a-875f-358279946733 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:03.784060 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8a101452-ffa4-419a-875f-358279946733 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:03.784511 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8a101452-ffa4-419a-875f-358279946733 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:03.785289 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8a101452-ffa4-419a-875f-358279946733 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:03.785722 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8a101452-ffa4-419a-875f-358279946733 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:03.846010 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-8a101452-ffa4-419a-875f-358279946733 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:03.853473 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-8a101452-ffa4-419a-875f-358279946733 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1210 microversion: 2.1 time: 0.079970 Nov 20 03:27:03.854029 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 272/462] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:03 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1210 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:04.206163 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-f6c83f2b-11e4-478a-ba14-aee62b849371 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:04.206775 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-f6c83f2b-11e4-478a-ba14-aee62b849371 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: 4111c671-ac86-42f4-8753-e38deb7c21a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:04.213098 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f6c83f2b-11e4-478a-ba14-aee62b849371 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:04.213552 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f6c83f2b-11e4-478a-ba14-aee62b849371 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:04.214326 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f6c83f2b-11e4-478a-ba14-aee62b849371 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:04.214762 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f6c83f2b-11e4-478a-ba14-aee62b849371 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:04.342733 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-7a1c7226-6deb-40f4-88f0-7a35ce7fc272 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:04.343353 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-7a1c7226-6deb-40f4-88f0-7a35ce7fc272 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:04.343658 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-f6c83f2b-11e4-478a-ba14-aee62b849371 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:04.350061 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7a1c7226-6deb-40f4-88f0-7a35ce7fc272 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:04.350514 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7a1c7226-6deb-40f4-88f0-7a35ce7fc272 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:04.351233 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-f6c83f2b-11e4-478a-ba14-aee62b849371 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0" status: 200 len: 1502 microversion: 2.1 time: 0.148724 Nov 20 03:27:04.351340 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7a1c7226-6deb-40f4-88f0-7a35ce7fc272 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:04.351751 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7a1c7226-6deb-40f4-88f0-7a35ce7fc272 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:04.351915 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 191/463] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:04 2021] GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0 => generated 1502 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:04.409417 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-4975518c-0ae7-476d-ba10-8c542da7a207 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:04.410030 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-4975518c-0ae7-476d-ba10-8c542da7a207 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:04.415946 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4975518c-0ae7-476d-ba10-8c542da7a207 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:04.416408 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4975518c-0ae7-476d-ba10-8c542da7a207 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:04.417189 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4975518c-0ae7-476d-ba10-8c542da7a207 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:04.417627 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4975518c-0ae7-476d-ba10-8c542da7a207 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:04.506660 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-7a1c7226-6deb-40f4-88f0-7a35ce7fc272 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:04.515114 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-7a1c7226-6deb-40f4-88f0-7a35ce7fc272 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1557 microversion: 2.1 time: 0.176486 Nov 20 03:27:04.515681 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 273/464] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:04 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1557 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:04.568746 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-4975518c-0ae7-476d-ba10-8c542da7a207 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:04.577700 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-4975518c-0ae7-476d-ba10-8c542da7a207 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:04.579213 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-4975518c-0ae7-476d-ba10-8c542da7a207 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:04.580423 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-4975518c-0ae7-476d-ba10-8c542da7a207 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1751 microversion: 2.20 time: 0.174760 Nov 20 03:27:04.581582 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 192/465] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:04 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:27:04.710021 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-1cd60187-6bbe-4632-9973-079e691c061a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:04.710634 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-1cd60187-6bbe-4632-9973-079e691c061a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:04.716489 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1cd60187-6bbe-4632-9973-079e691c061a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:04.716943 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1cd60187-6bbe-4632-9973-079e691c061a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:04.717717 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1cd60187-6bbe-4632-9973-079e691c061a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:04.718152 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1cd60187-6bbe-4632-9973-079e691c061a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:04.843177 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-1cd60187-6bbe-4632-9973-079e691c061a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:04.850641 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-1cd60187-6bbe-4632-9973-079e691c061a tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 200 len: 1318 microversion: 2.1 time: 0.144244 Nov 20 03:27:04.851204 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 274/466] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:04 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:04.869833 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-20b8de00-ede1-49dd-b6dc-71eed65bc89c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:04.870440 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-20b8de00-ede1-49dd-b6dc-71eed65bc89c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:04.876663 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-20b8de00-ede1-49dd-b6dc-71eed65bc89c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:04.877119 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-20b8de00-ede1-49dd-b6dc-71eed65bc89c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:04.877894 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-20b8de00-ede1-49dd-b6dc-71eed65bc89c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:04.878331 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-20b8de00-ede1-49dd-b6dc-71eed65bc89c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:04.938809 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-20b8de00-ede1-49dd-b6dc-71eed65bc89c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:04.945904 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-20b8de00-ede1-49dd-b6dc-71eed65bc89c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1210 microversion: 2.1 time: 0.079658 Nov 20 03:27:04.946464 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 193/467] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:04 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1210 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:05.368837 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-bd73bfe6-2680-49f1-adc2-07f56c836c7c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:05.369369 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-bd73bfe6-2680-49f1-adc2-07f56c836c7c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: 4111c671-ac86-42f4-8753-e38deb7c21a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:05.375710 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bd73bfe6-2680-49f1-adc2-07f56c836c7c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:05.376195 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bd73bfe6-2680-49f1-adc2-07f56c836c7c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:05.377000 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bd73bfe6-2680-49f1-adc2-07f56c836c7c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:05.377437 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bd73bfe6-2680-49f1-adc2-07f56c836c7c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:05.505486 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-bd73bfe6-2680-49f1-adc2-07f56c836c7c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:05.512688 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-bd73bfe6-2680-49f1-adc2-07f56c836c7c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0" status: 200 len: 1502 microversion: 2.1 time: 0.147686 Nov 20 03:27:05.513248 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 275/468] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:05 2021] GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0 => generated 1502 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:05.532618 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-bf2fc024-e050-4575-bb13-ef6eb5c2a66c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:05.533282 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-bf2fc024-e050-4575-bb13-ef6eb5c2a66c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:05.539519 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bf2fc024-e050-4575-bb13-ef6eb5c2a66c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:05.540009 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bf2fc024-e050-4575-bb13-ef6eb5c2a66c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:05.540785 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bf2fc024-e050-4575-bb13-ef6eb5c2a66c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:05.541224 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bf2fc024-e050-4575-bb13-ef6eb5c2a66c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:05.598464 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-9ae8d6c2-d818-4891-ac1b-f6dd18b106ea tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:05.599075 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-9ae8d6c2-d818-4891-ac1b-f6dd18b106ea tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:05.604992 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9ae8d6c2-d818-4891-ac1b-f6dd18b106ea tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:05.605448 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9ae8d6c2-d818-4891-ac1b-f6dd18b106ea tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:05.606230 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9ae8d6c2-d818-4891-ac1b-f6dd18b106ea tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:05.607317 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9ae8d6c2-d818-4891-ac1b-f6dd18b106ea tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:05.699741 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-bf2fc024-e050-4575-bb13-ef6eb5c2a66c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:05.708070 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-bf2fc024-e050-4575-bb13-ef6eb5c2a66c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1557 microversion: 2.1 time: 0.179554 Nov 20 03:27:05.708637 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 194/469] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:05 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1557 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:05.758135 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9ae8d6c2-d818-4891-ac1b-f6dd18b106ea tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:05.766707 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9ae8d6c2-d818-4891-ac1b-f6dd18b106ea tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:05.768249 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9ae8d6c2-d818-4891-ac1b-f6dd18b106ea tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:05.769396 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-9ae8d6c2-d818-4891-ac1b-f6dd18b106ea tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1751 microversion: 2.20 time: 0.174889 Nov 20 03:27:05.769945 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 276/470] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:05 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:27:05.866899 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-cfa4a40a-e329-4d8e-871f-054382a02982 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:05.867513 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-cfa4a40a-e329-4d8e-871f-054382a02982 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:05.873496 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cfa4a40a-e329-4d8e-871f-054382a02982 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:05.873897 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cfa4a40a-e329-4d8e-871f-054382a02982 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:05.874695 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cfa4a40a-e329-4d8e-871f-054382a02982 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:05.875160 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cfa4a40a-e329-4d8e-871f-054382a02982 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:05.962323 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-9d3d0463-92f2-4a87-92a6-8c1a65507d67 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:05.963017 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-9d3d0463-92f2-4a87-92a6-8c1a65507d67 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:05.969649 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9d3d0463-92f2-4a87-92a6-8c1a65507d67 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:05.970206 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9d3d0463-92f2-4a87-92a6-8c1a65507d67 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:05.971064 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9d3d0463-92f2-4a87-92a6-8c1a65507d67 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:05.971566 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9d3d0463-92f2-4a87-92a6-8c1a65507d67 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:06.005975 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-cfa4a40a-e329-4d8e-871f-054382a02982 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:06.013730 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-cfa4a40a-e329-4d8e-871f-054382a02982 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 200 len: 1318 microversion: 2.1 time: 0.149893 Nov 20 03:27:06.014296 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 195/471] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:05 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:06.031931 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9d3d0463-92f2-4a87-92a6-8c1a65507d67 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:06.039249 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-9d3d0463-92f2-4a87-92a6-8c1a65507d67 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1210 microversion: 2.1 time: 0.080699 Nov 20 03:27:06.039843 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 277/472] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:05 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1210 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:06.529263 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-b17b05e3-35c3-48e8-a8f0-8150397fcbd8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:06.530009 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-b17b05e3-35c3-48e8-a8f0-8150397fcbd8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: 4111c671-ac86-42f4-8753-e38deb7c21a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:06.535819 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b17b05e3-35c3-48e8-a8f0-8150397fcbd8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:06.536390 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b17b05e3-35c3-48e8-a8f0-8150397fcbd8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:06.537153 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b17b05e3-35c3-48e8-a8f0-8150397fcbd8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:06.537667 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b17b05e3-35c3-48e8-a8f0-8150397fcbd8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:06.726590 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-31396e19-903e-483a-943f-77abbf9d148f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:06.727185 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-31396e19-903e-483a-943f-77abbf9d148f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:06.734007 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-31396e19-903e-483a-943f-77abbf9d148f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:06.734463 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-31396e19-903e-483a-943f-77abbf9d148f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:06.735255 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-31396e19-903e-483a-943f-77abbf9d148f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:06.735698 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-31396e19-903e-483a-943f-77abbf9d148f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:06.788685 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-b17b05e3-35c3-48e8-a8f0-8150397fcbd8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:06.797753 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-b17b05e3-35c3-48e8-a8f0-8150397fcbd8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0" status: 200 len: 1502 microversion: 2.1 time: 0.272094 Nov 20 03:27:06.798328 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 196/473] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:06 2021] GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0 => generated 1502 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:06.804557 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-dcaf1998-967a-4107-aa5d-d118a74690a8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:06.805884 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-dcaf1998-967a-4107-aa5d-d118a74690a8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:06.812241 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dcaf1998-967a-4107-aa5d-d118a74690a8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:06.812943 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dcaf1998-967a-4107-aa5d-d118a74690a8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:06.813737 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dcaf1998-967a-4107-aa5d-d118a74690a8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:06.814176 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dcaf1998-967a-4107-aa5d-d118a74690a8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:06.992336 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-31396e19-903e-483a-943f-77abbf9d148f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:07.000244 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-31396e19-903e-483a-943f-77abbf9d148f tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1557 microversion: 2.1 time: 0.278173 Nov 20 03:27:07.000816 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 278/474] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:06 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1557 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:07.032084 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-1f2a9a63-aad1-4dbd-ab3a-8f934301b86f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:07.032705 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-1f2a9a63-aad1-4dbd-ab3a-8f934301b86f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:07.040083 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1f2a9a63-aad1-4dbd-ab3a-8f934301b86f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:07.040549 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1f2a9a63-aad1-4dbd-ab3a-8f934301b86f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:07.041397 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1f2a9a63-aad1-4dbd-ab3a-8f934301b86f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:07.041842 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1f2a9a63-aad1-4dbd-ab3a-8f934301b86f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:07.100086 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-dcaf1998-967a-4107-aa5d-d118a74690a8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:07.109492 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-dcaf1998-967a-4107-aa5d-d118a74690a8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:07.111119 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-dcaf1998-967a-4107-aa5d-d118a74690a8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:07.112747 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-dcaf1998-967a-4107-aa5d-d118a74690a8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1753 microversion: 2.20 time: 0.313220 Nov 20 03:27:07.113428 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 197/475] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:06 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1753 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:27:07.117886 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-6022457b-f233-48fd-a6cd-a8cb80406179 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:07.118758 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-6022457b-f233-48fd-a6cd-a8cb80406179 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:07.125648 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6022457b-f233-48fd-a6cd-a8cb80406179 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:07.126098 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6022457b-f233-48fd-a6cd-a8cb80406179 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:07.126887 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6022457b-f233-48fd-a6cd-a8cb80406179 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:07.127327 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6022457b-f233-48fd-a6cd-a8cb80406179 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:07.243666 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-1f2a9a63-aad1-4dbd-ab3a-8f934301b86f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:07.251157 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-1f2a9a63-aad1-4dbd-ab3a-8f934301b86f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 200 len: 1318 microversion: 2.1 time: 0.224330 Nov 20 03:27:07.252079 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 279/476] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:07 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:07.304245 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-6022457b-f233-48fd-a6cd-a8cb80406179 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:07.311613 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-6022457b-f233-48fd-a6cd-a8cb80406179 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1278 microversion: 2.1 time: 0.197178 Nov 20 03:27:07.312216 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 198/477] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:07 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1278 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:07.814506 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-7ae80df1-6d9c-4222-8d49-68b8a23f7d9d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:07.815112 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-7ae80df1-6d9c-4222-8d49-68b8a23f7d9d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: 4111c671-ac86-42f4-8753-e38deb7c21a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:07.821442 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7ae80df1-6d9c-4222-8d49-68b8a23f7d9d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:07.821890 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7ae80df1-6d9c-4222-8d49-68b8a23f7d9d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:07.822652 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7ae80df1-6d9c-4222-8d49-68b8a23f7d9d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:07.823084 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7ae80df1-6d9c-4222-8d49-68b8a23f7d9d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:07.954705 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-7ae80df1-6d9c-4222-8d49-68b8a23f7d9d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:07.962140 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-7ae80df1-6d9c-4222-8d49-68b8a23f7d9d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0" status: 200 len: 1502 microversion: 2.1 time: 0.151187 Nov 20 03:27:07.962706 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 280/478] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:07 2021] GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:08.016735 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-02244421-cafc-4c3f-b85a-0532a12cc49a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:08.017345 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-02244421-cafc-4c3f-b85a-0532a12cc49a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:08.023735 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-02244421-cafc-4c3f-b85a-0532a12cc49a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:08.024223 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-02244421-cafc-4c3f-b85a-0532a12cc49a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:08.025005 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-02244421-cafc-4c3f-b85a-0532a12cc49a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:08.025457 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-02244421-cafc-4c3f-b85a-0532a12cc49a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:08.132031 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-86346d54-3307-4a44-8695-b2bae9ed987a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:08.132734 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-86346d54-3307-4a44-8695-b2bae9ed987a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:08.138592 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-86346d54-3307-4a44-8695-b2bae9ed987a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:08.139042 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-86346d54-3307-4a44-8695-b2bae9ed987a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:08.139838 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-86346d54-3307-4a44-8695-b2bae9ed987a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:08.140274 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-86346d54-3307-4a44-8695-b2bae9ed987a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:08.154336 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-02244421-cafc-4c3f-b85a-0532a12cc49a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:08.162004 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-02244421-cafc-4c3f-b85a-0532a12cc49a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1557 microversion: 2.1 time: 0.148864 Nov 20 03:27:08.162573 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 199/479] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:08 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:08.267713 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-86346d54-3307-4a44-8695-b2bae9ed987a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:08.268141 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-18fc3497-365c-4460-8581-0ef9d0e57368 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:08.268792 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-18fc3497-365c-4460-8581-0ef9d0e57368 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:08.274536 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-18fc3497-365c-4460-8581-0ef9d0e57368 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:08.274986 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-18fc3497-365c-4460-8581-0ef9d0e57368 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:08.275766 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-18fc3497-365c-4460-8581-0ef9d0e57368 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:08.276067 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-86346d54-3307-4a44-8695-b2bae9ed987a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:08.276246 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-18fc3497-365c-4460-8581-0ef9d0e57368 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:08.277558 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-86346d54-3307-4a44-8695-b2bae9ed987a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:08.279224 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-86346d54-3307-4a44-8695-b2bae9ed987a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1753 microversion: 2.20 time: 0.150361 Nov 20 03:27:08.279760 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 281/480] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:08 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:27:08.328302 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-2f8ea2a5-1745-4a50-bc66-f6e0a9cd8d14 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:08.328917 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-2f8ea2a5-1745-4a50-bc66-f6e0a9cd8d14 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:08.334804 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2f8ea2a5-1745-4a50-bc66-f6e0a9cd8d14 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:08.335270 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2f8ea2a5-1745-4a50-bc66-f6e0a9cd8d14 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:08.336075 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2f8ea2a5-1745-4a50-bc66-f6e0a9cd8d14 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:08.336518 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2f8ea2a5-1745-4a50-bc66-f6e0a9cd8d14 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:08.433934 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-18fc3497-365c-4460-8581-0ef9d0e57368 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:08.441195 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-18fc3497-365c-4460-8581-0ef9d0e57368 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 200 len: 1318 microversion: 2.1 time: 0.176775 Nov 20 03:27:08.441826 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 200/481] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:08 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:08.494262 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-2f8ea2a5-1745-4a50-bc66-f6e0a9cd8d14 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:08.501496 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-2f8ea2a5-1745-4a50-bc66-f6e0a9cd8d14 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1278 microversion: 2.1 time: 0.176831 Nov 20 03:27:08.502054 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 282/482] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:08 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1278 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:08.978657 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-0a0289d7-545b-42c8-8d18-53ff30b11d52 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:08.979260 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-0a0289d7-545b-42c8-8d18-53ff30b11d52 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: 4111c671-ac86-42f4-8753-e38deb7c21a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:08.985334 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0a0289d7-545b-42c8-8d18-53ff30b11d52 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:08.985776 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0a0289d7-545b-42c8-8d18-53ff30b11d52 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:08.986563 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0a0289d7-545b-42c8-8d18-53ff30b11d52 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:08.986991 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0a0289d7-545b-42c8-8d18-53ff30b11d52 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:09.116832 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-0a0289d7-545b-42c8-8d18-53ff30b11d52 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:09.124593 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-0a0289d7-545b-42c8-8d18-53ff30b11d52 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0" status: 200 len: 1502 microversion: 2.1 time: 0.149545 Nov 20 03:27:09.125188 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 201/483] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:08 2021] GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0 => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:09.180512 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-1554c661-7039-4612-8ca9-635f077a2ba5 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:09.181480 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-1554c661-7039-4612-8ca9-635f077a2ba5 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:09.188548 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1554c661-7039-4612-8ca9-635f077a2ba5 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:09.189103 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1554c661-7039-4612-8ca9-635f077a2ba5 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:09.189940 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1554c661-7039-4612-8ca9-635f077a2ba5 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:09.190438 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1554c661-7039-4612-8ca9-635f077a2ba5 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:09.297105 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-76719479-5dde-4b0d-a491-41e6fd74cb64 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:09.297742 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-76719479-5dde-4b0d-a491-41e6fd74cb64 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:09.303488 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-76719479-5dde-4b0d-a491-41e6fd74cb64 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:09.303972 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-76719479-5dde-4b0d-a491-41e6fd74cb64 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:09.304747 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-76719479-5dde-4b0d-a491-41e6fd74cb64 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:09.305177 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-76719479-5dde-4b0d-a491-41e6fd74cb64 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:09.323865 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-1554c661-7039-4612-8ca9-635f077a2ba5 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:09.332056 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-1554c661-7039-4612-8ca9-635f077a2ba5 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1557 microversion: 2.1 time: 0.156231 Nov 20 03:27:09.332614 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 283/484] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:09 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:09.437719 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-76719479-5dde-4b0d-a491-41e6fd74cb64 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:09.445824 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-76719479-5dde-4b0d-a491-41e6fd74cb64 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:09.447357 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-76719479-5dde-4b0d-a491-41e6fd74cb64 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:09.448532 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-76719479-5dde-4b0d-a491-41e6fd74cb64 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1753 microversion: 2.20 time: 0.155176 Nov 20 03:27:09.449085 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 202/485] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:09 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:27:09.457460 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-23444b74-f335-4909-9ca6-c982b9942fe9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:09.458157 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-23444b74-f335-4909-9ca6-c982b9942fe9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:09.463983 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-23444b74-f335-4909-9ca6-c982b9942fe9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:09.464429 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-23444b74-f335-4909-9ca6-c982b9942fe9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:09.465197 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-23444b74-f335-4909-9ca6-c982b9942fe9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:09.465632 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-23444b74-f335-4909-9ca6-c982b9942fe9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:09.517780 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-43677787-a507-4d53-94ea-c75f039cfb24 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:09.518386 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-43677787-a507-4d53-94ea-c75f039cfb24 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:09.524153 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-43677787-a507-4d53-94ea-c75f039cfb24 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:09.524602 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-43677787-a507-4d53-94ea-c75f039cfb24 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:09.525376 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-43677787-a507-4d53-94ea-c75f039cfb24 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:09.525809 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-43677787-a507-4d53-94ea-c75f039cfb24 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:09.634920 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-23444b74-f335-4909-9ca6-c982b9942fe9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:09.642196 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-23444b74-f335-4909-9ca6-c982b9942fe9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 200 len: 1318 microversion: 2.1 time: 0.188268 Nov 20 03:27:09.642764 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 284/486] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:09 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:09.679585 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-43677787-a507-4d53-94ea-c75f039cfb24 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:09.687460 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-43677787-a507-4d53-94ea-c75f039cfb24 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1278 microversion: 2.1 time: 0.173274 Nov 20 03:27:09.688068 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 203/487] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:09 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:10.141964 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-e75a5b76-fad1-4422-b634-05ef722cee44 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:10.142689 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-e75a5b76-fad1-4422-b634-05ef722cee44 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: 4111c671-ac86-42f4-8753-e38deb7c21a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:10.149335 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e75a5b76-fad1-4422-b634-05ef722cee44 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:10.149797 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e75a5b76-fad1-4422-b634-05ef722cee44 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:10.150567 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e75a5b76-fad1-4422-b634-05ef722cee44 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:10.150998 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e75a5b76-fad1-4422-b634-05ef722cee44 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:10.350371 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-13a13b8a-a231-4f90-a811-9c1e0eec5880 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:10.351557 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-13a13b8a-a231-4f90-a811-9c1e0eec5880 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:10.360874 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-13a13b8a-a231-4f90-a811-9c1e0eec5880 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:10.361676 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-13a13b8a-a231-4f90-a811-9c1e0eec5880 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:10.362393 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-13a13b8a-a231-4f90-a811-9c1e0eec5880 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:10.362899 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-13a13b8a-a231-4f90-a811-9c1e0eec5880 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:10.376154 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-e75a5b76-fad1-4422-b634-05ef722cee44 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:10.385132 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-e75a5b76-fad1-4422-b634-05ef722cee44 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0" status: 200 len: 1502 microversion: 2.1 time: 0.247483 Nov 20 03:27:10.386389 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 285/488] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:10 2021] GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0 => generated 1502 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:10.467130 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-afcd59a3-58bf-469c-90b3-235929321900 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:10.467628 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-afcd59a3-58bf-469c-90b3-235929321900 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:10.473659 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-afcd59a3-58bf-469c-90b3-235929321900 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:10.474111 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-afcd59a3-58bf-469c-90b3-235929321900 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:10.474892 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-afcd59a3-58bf-469c-90b3-235929321900 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:10.475325 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-afcd59a3-58bf-469c-90b3-235929321900 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:10.664410 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-13a13b8a-a231-4f90-a811-9c1e0eec5880 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:10.673290 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-13a13b8a-a231-4f90-a811-9c1e0eec5880 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1557 microversion: 2.1 time: 0.326826 Nov 20 03:27:10.674596 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 204/489] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:10 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1557 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:10.679695 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-51741ba9-748a-41ec-80c5-430b9e617069 req-2e85017a-34e6-40d8-821b-eef358e85134 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f64dd34e-277a-4033-8330-d0dd481d287c", "tag": "243add17-6449-4a77-8663-2a184bd82457"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:27:10.681464 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:27:10.681464 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:27:10.693883 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-51741ba9-748a-41ec-80c5-430b9e617069 req-2e85017a-34e6-40d8-821b-eef358e85134 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:10.694438 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-51741ba9-748a-41ec-80c5-430b9e617069 req-2e85017a-34e6-40d8-821b-eef358e85134 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:10.706498 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-51741ba9-748a-41ec-80c5-430b9e617069 req-2e85017a-34e6-40d8-821b-eef358e85134 service nova] Creating event network-changed:243add17-6449-4a77-8663-2a184bd82457 for instance f64dd34e-277a-4033-8330-d0dd481d287c on hv-cinder-81803 Nov 20 03:27:10.712325 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-51741ba9-748a-41ec-80c5-430b9e617069 req-2e85017a-34e6-40d8-821b-eef358e85134 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036224 Nov 20 03:27:10.713024 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 205/490] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:27:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:27:10.718047 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-a9dc9a33-70f1-46e0-849d-02ce4f27b7cd tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:10.718754 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-a9dc9a33-70f1-46e0-849d-02ce4f27b7cd tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:10.725373 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a9dc9a33-70f1-46e0-849d-02ce4f27b7cd tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:10.725996 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a9dc9a33-70f1-46e0-849d-02ce4f27b7cd tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:10.726865 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a9dc9a33-70f1-46e0-849d-02ce4f27b7cd tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:10.727357 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a9dc9a33-70f1-46e0-849d-02ce4f27b7cd tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:10.761111 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-afcd59a3-58bf-469c-90b3-235929321900 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:10.770159 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-afcd59a3-58bf-469c-90b3-235929321900 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:10.771679 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-afcd59a3-58bf-469c-90b3-235929321900 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:10.772972 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-afcd59a3-58bf-469c-90b3-235929321900 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1753 microversion: 2.20 time: 0.310347 Nov 20 03:27:10.773826 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 286/491] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:10 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1753 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:27:10.778021 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-c4f9fe68-1097-4476-9c87-bc4da0d2f24f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:10.778648 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-c4f9fe68-1097-4476-9c87-bc4da0d2f24f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:10.784830 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c4f9fe68-1097-4476-9c87-bc4da0d2f24f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:10.785279 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c4f9fe68-1097-4476-9c87-bc4da0d2f24f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:10.786112 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c4f9fe68-1097-4476-9c87-bc4da0d2f24f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:10.786569 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c4f9fe68-1097-4476-9c87-bc4da0d2f24f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:11.005458 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-a9dc9a33-70f1-46e0-849d-02ce4f27b7cd tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:11.013368 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-a9dc9a33-70f1-46e0-849d-02ce4f27b7cd tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 200 len: 1318 microversion: 2.1 time: 0.299104 Nov 20 03:27:11.013934 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 206/492] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:10 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:11.029887 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-c4f9fe68-1097-4476-9c87-bc4da0d2f24f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:11.037975 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-c4f9fe68-1097-4476-9c87-bc4da0d2f24f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1278 microversion: 2.1 time: 0.263136 Nov 20 03:27:11.039123 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 287/493] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:10 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1278 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:11.405157 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-2699b312-c090-4bd1-a7f8-468769262095 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:11.405552 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-2699b312-c090-4bd1-a7f8-468769262095 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: 4111c671-ac86-42f4-8753-e38deb7c21a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:11.413361 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2699b312-c090-4bd1-a7f8-468769262095 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:11.413778 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2699b312-c090-4bd1-a7f8-468769262095 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:11.414746 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2699b312-c090-4bd1-a7f8-468769262095 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:11.415558 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2699b312-c090-4bd1-a7f8-468769262095 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:11.654356 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-2699b312-c090-4bd1-a7f8-468769262095 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:11.661838 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-2699b312-c090-4bd1-a7f8-468769262095 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0" status: 200 len: 1502 microversion: 2.1 time: 0.262904 Nov 20 03:27:11.662403 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 207/494] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:11 2021] GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0 => generated 1502 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:11.690172 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-7034186f-82f9-445d-a8d2-a5a769233d47 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:11.690952 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-7034186f-82f9-445d-a8d2-a5a769233d47 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:11.697817 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7034186f-82f9-445d-a8d2-a5a769233d47 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:11.698261 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7034186f-82f9-445d-a8d2-a5a769233d47 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:11.699039 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7034186f-82f9-445d-a8d2-a5a769233d47 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:11.699466 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7034186f-82f9-445d-a8d2-a5a769233d47 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:11.791890 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-1d6d5729-3779-4060-8a0e-1260bb4630d8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:11.792531 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-1d6d5729-3779-4060-8a0e-1260bb4630d8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:11.798274 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1d6d5729-3779-4060-8a0e-1260bb4630d8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:11.798723 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1d6d5729-3779-4060-8a0e-1260bb4630d8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:11.799525 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1d6d5729-3779-4060-8a0e-1260bb4630d8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:11.800011 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1d6d5729-3779-4060-8a0e-1260bb4630d8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:11.913676 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-7034186f-82f9-445d-a8d2-a5a769233d47 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:11.923678 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-7034186f-82f9-445d-a8d2-a5a769233d47 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1557 microversion: 2.1 time: 0.237086 Nov 20 03:27:11.924358 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 288/495] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:11 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1557 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:12.017965 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-1d6d5729-3779-4060-8a0e-1260bb4630d8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:12.026856 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-1d6d5729-3779-4060-8a0e-1260bb4630d8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:12.028515 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-1d6d5729-3779-4060-8a0e-1260bb4630d8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:12.029087 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-cc010d90-a674-4409-bd4d-de02d7fb7a3c tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:12.029702 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-cc010d90-a674-4409-bd4d-de02d7fb7a3c tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:12.029870 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-1d6d5729-3779-4060-8a0e-1260bb4630d8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1753 microversion: 2.20 time: 0.241603 Nov 20 03:27:12.030377 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 208/496] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:11 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1753 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:27:12.036068 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cc010d90-a674-4409-bd4d-de02d7fb7a3c tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:12.036524 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cc010d90-a674-4409-bd4d-de02d7fb7a3c tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:12.037296 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cc010d90-a674-4409-bd4d-de02d7fb7a3c tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:12.038398 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cc010d90-a674-4409-bd4d-de02d7fb7a3c tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:12.056653 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-7ffdb241-5e91-4129-9809-c0228e449363 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:12.058111 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-7ffdb241-5e91-4129-9809-c0228e449363 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:12.064411 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7ffdb241-5e91-4129-9809-c0228e449363 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:12.064858 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7ffdb241-5e91-4129-9809-c0228e449363 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:12.065639 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7ffdb241-5e91-4129-9809-c0228e449363 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:12.066068 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7ffdb241-5e91-4129-9809-c0228e449363 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:12.464494 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-cc010d90-a674-4409-bd4d-de02d7fb7a3c tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:12.476069 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-cc010d90-a674-4409-bd4d-de02d7fb7a3c tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 200 len: 1508 microversion: 2.1 time: 0.450130 Nov 20 03:27:12.476921 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 289/497] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:12 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 1508 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:12.502357 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-7ffdb241-5e91-4129-9809-c0228e449363 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:12.513448 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-7ffdb241-5e91-4129-9809-c0228e449363 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1266 microversion: 2.1 time: 0.460263 Nov 20 03:27:12.514247 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 209/498] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:12 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1266 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:12.679905 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-dc2bf00b-8d7c-4aae-9d12-cdbedfd40b8b tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:12.680829 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-dc2bf00b-8d7c-4aae-9d12-cdbedfd40b8b tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: 4111c671-ac86-42f4-8753-e38deb7c21a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:12.692006 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dc2bf00b-8d7c-4aae-9d12-cdbedfd40b8b tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:12.693721 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dc2bf00b-8d7c-4aae-9d12-cdbedfd40b8b tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:12.694732 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dc2bf00b-8d7c-4aae-9d12-cdbedfd40b8b tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:12.695685 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dc2bf00b-8d7c-4aae-9d12-cdbedfd40b8b tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:12.933040 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-dc2bf00b-8d7c-4aae-9d12-cdbedfd40b8b tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:12.940765 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-2fece350-6b17-4158-8a08-036b30823efc tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:12.941026 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-dc2bf00b-8d7c-4aae-9d12-cdbedfd40b8b tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0" status: 200 len: 1502 microversion: 2.1 time: 0.266250 Nov 20 03:27:12.941379 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-2fece350-6b17-4158-8a08-036b30823efc tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:12.941776 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 290/499] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:12 2021] GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0 => generated 1502 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:12.947289 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2fece350-6b17-4158-8a08-036b30823efc tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:12.947742 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2fece350-6b17-4158-8a08-036b30823efc tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:12.948557 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2fece350-6b17-4158-8a08-036b30823efc tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:12.948989 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2fece350-6b17-4158-8a08-036b30823efc tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:13.049253 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-273dc3e7-ece9-4a1f-8340-b4d6f5743bc5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:13.049893 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-273dc3e7-ece9-4a1f-8340-b4d6f5743bc5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:13.056167 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-273dc3e7-ece9-4a1f-8340-b4d6f5743bc5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:13.056631 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-273dc3e7-ece9-4a1f-8340-b4d6f5743bc5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:13.057426 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-273dc3e7-ece9-4a1f-8340-b4d6f5743bc5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:13.057904 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-273dc3e7-ece9-4a1f-8340-b4d6f5743bc5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:13.161113 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-2fece350-6b17-4158-8a08-036b30823efc tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:13.170879 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-2fece350-6b17-4158-8a08-036b30823efc tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1563 microversion: 2.1 time: 0.234265 Nov 20 03:27:13.171475 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 210/500] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:12 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1563 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:13.175808 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-53b3dc0c-502e-4ada-95cd-32e33615229d req-66aa91bf-831b-40cd-8ff7-5c95e8569306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4111c671-ac86-42f4-8753-e38deb7c21a0", "name": "network-vif-deleted", "tag": "0af31e15-9931-4f34-8890-97b152868a29"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:27:13.177537 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:27:13.177537 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:27:13.184758 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-53b3dc0c-502e-4ada-95cd-32e33615229d req-66aa91bf-831b-40cd-8ff7-5c95e8569306 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:13.185418 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-53b3dc0c-502e-4ada-95cd-32e33615229d req-66aa91bf-831b-40cd-8ff7-5c95e8569306 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:13.213291 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-53b3dc0c-502e-4ada-95cd-32e33615229d req-66aa91bf-831b-40cd-8ff7-5c95e8569306 service nova] Creating event network-vif-deleted:0af31e15-9931-4f34-8890-97b152868a29 for instance 4111c671-ac86-42f4-8753-e38deb7c21a0 on hv-cinder-81803 Nov 20 03:27:13.219628 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-53b3dc0c-502e-4ada-95cd-32e33615229d req-66aa91bf-831b-40cd-8ff7-5c95e8569306 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047000 Nov 20 03:27:13.220255 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 211/501] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:27:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:27:13.241206 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-273dc3e7-ece9-4a1f-8340-b4d6f5743bc5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:13.250766 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-273dc3e7-ece9-4a1f-8340-b4d6f5743bc5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:13.251576 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-2709d71b-ce37-4661-8807-224346beb502 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:13.252270 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-2709d71b-ce37-4661-8807-224346beb502 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:13.253268 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-273dc3e7-ece9-4a1f-8340-b4d6f5743bc5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:13.254729 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-273dc3e7-ece9-4a1f-8340-b4d6f5743bc5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1809 microversion: 2.20 time: 0.209431 Nov 20 03:27:13.257181 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 291/502] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:13 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1809 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:27:13.261172 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2709d71b-ce37-4661-8807-224346beb502 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:13.261671 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2709d71b-ce37-4661-8807-224346beb502 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:13.263092 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2709d71b-ce37-4661-8807-224346beb502 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:13.263536 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2709d71b-ce37-4661-8807-224346beb502 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:13.402232 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.objects.instance [None req-2709d71b-ce37-4661-8807-224346beb502 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lazy-loading 'services' on Instance uuid 1520eab8-d6b9-48aa-8333-5c7758310e82 {{(pid=116114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 03:27:13.517261 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-2709d71b-ce37-4661-8807-224346beb502 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "DELETE /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments/11593169-ca31-4702-b62b-5f4fd37cb698" status: 202 len: 0 microversion: 2.1 time: 0.271449 Nov 20 03:27:13.518731 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 212/503] 10.222.0.37 () {58 vars in 1415 bytes} [Sat Nov 20 03:27:13 2021] DELETE /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments/11593169-ca31-4702-b62b-5f4fd37cb698 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:27:13.526993 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-dd92a06d-e9ca-4596-bdd7-9a05c52f0a03 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:13.528266 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-dd92a06d-e9ca-4596-bdd7-9a05c52f0a03 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:13.534787 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dd92a06d-e9ca-4596-bdd7-9a05c52f0a03 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:13.535600 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dd92a06d-e9ca-4596-bdd7-9a05c52f0a03 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:13.536596 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dd92a06d-e9ca-4596-bdd7-9a05c52f0a03 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:13.537038 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dd92a06d-e9ca-4596-bdd7-9a05c52f0a03 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:13.541359 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-104b6167-a1c7-42e5-b767-3137be7adc75 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:13.542337 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-104b6167-a1c7-42e5-b767-3137be7adc75 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:13.549857 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-104b6167-a1c7-42e5-b767-3137be7adc75 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:13.550463 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-104b6167-a1c7-42e5-b767-3137be7adc75 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:13.551456 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-104b6167-a1c7-42e5-b767-3137be7adc75 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:13.552009 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-104b6167-a1c7-42e5-b767-3137be7adc75 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:13.571119 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-dd92a06d-e9ca-4596-bdd7-9a05c52f0a03 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047951 Nov 20 03:27:13.572002 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 292/504] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:27:13 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:27:13.907604 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-2c5fb8b5-954e-49b7-b027-e3d507a72bf5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7e7a531-e26f-48a5-9502-2d3488a9fe1f"}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:27:13.908820 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-2c5fb8b5-954e-49b7-b027-e3d507a72bf5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:13.914704 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2c5fb8b5-954e-49b7-b027-e3d507a72bf5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:13.915146 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2c5fb8b5-954e-49b7-b027-e3d507a72bf5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:13.916158 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2c5fb8b5-954e-49b7-b027-e3d507a72bf5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:13.916745 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2c5fb8b5-954e-49b7-b027-e3d507a72bf5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:13.981137 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-104b6167-a1c7-42e5-b767-3137be7adc75 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:13.988990 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-104b6167-a1c7-42e5-b767-3137be7adc75 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1266 microversion: 2.1 time: 0.457231 Nov 20 03:27:13.989626 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 213/505] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:13 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1266 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:14.001587 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-6b9b558e-c98a-4577-adac-2e41b20727e2 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:14.002333 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-6b9b558e-c98a-4577-adac-2e41b20727e2 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: 4111c671-ac86-42f4-8753-e38deb7c21a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:14.012422 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6b9b558e-c98a-4577-adac-2e41b20727e2 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:14.013102 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6b9b558e-c98a-4577-adac-2e41b20727e2 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:14.014346 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6b9b558e-c98a-4577-adac-2e41b20727e2 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:14.014816 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6b9b558e-c98a-4577-adac-2e41b20727e2 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:14.029315 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.wsgi [None req-6b9b558e-c98a-4577-adac-2e41b20727e2 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] HTTP exception thrown: Instance 4111c671-ac86-42f4-8753-e38deb7c21a0 could not be found. Nov 20 03:27:14.029945 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-6b9b558e-c98a-4577-adac-2e41b20727e2 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Returning 404 to user: Instance 4111c671-ac86-42f4-8753-e38deb7c21a0 could not be found. {{(pid=116114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:27:14.030798 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-6b9b558e-c98a-4577-adac-2e41b20727e2 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0" status: 404 len: 111 microversion: 2.1 time: 0.040275 Nov 20 03:27:14.031414 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 214/506] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:13 2021] GET /compute/v2.1/servers/4111c671-ac86-42f4-8753-e38deb7c21a0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:27:14.114501 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-4f569530-398d-4426-b5fe-75dacae84bcd tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1310422739", "imageRef": "e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0", "flavorRef": "452", "networks": [{"uuid": "c40b0628-5368-4b0c-8d92-64cd48b8305d"}]}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:27:14.179140 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.network.neutron [None req-4f569530-398d-4426-b5fe-75dacae84bcd tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] validate_networks() for [('c40b0628-5368-4b0c-8d92-64cd48b8305d', None, None, None, None, None)] {{(pid=116114) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 03:27:14.242451 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-2c5fb8b5-954e-49b7-b027-e3d507a72bf5 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "POST /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.342933 Nov 20 03:27:14.243228 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 293/507] 10.222.0.37 () {60 vars in 1322 bytes} [Sat Nov 20 03:27:13 2021] POST /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285/os-volume_attachments => generated 194 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:27:14.279551 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-450b5d1e-efdf-4a32-b9d4-699bf43ae6b3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:14.281927 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-450b5d1e-efdf-4a32-b9d4-699bf43ae6b3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:14.290436 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-450b5d1e-efdf-4a32-b9d4-699bf43ae6b3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:14.291307 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-450b5d1e-efdf-4a32-b9d4-699bf43ae6b3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:14.292236 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-450b5d1e-efdf-4a32-b9d4-699bf43ae6b3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:14.292771 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-450b5d1e-efdf-4a32-b9d4-699bf43ae6b3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:14.585956 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-450b5d1e-efdf-4a32-b9d4-699bf43ae6b3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:14.595097 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-450b5d1e-efdf-4a32-b9d4-699bf43ae6b3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:14.596654 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-450b5d1e-efdf-4a32-b9d4-699bf43ae6b3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:14.598146 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-450b5d1e-efdf-4a32-b9d4-699bf43ae6b3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1809 microversion: 2.20 time: 0.326368 Nov 20 03:27:14.598695 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 294/508] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:14 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1809 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:27:14.603063 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-fe690bcc-91e0-481c-9abd-9db6a9ae2dd9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:14.604107 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-fe690bcc-91e0-481c-9abd-9db6a9ae2dd9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:14.610273 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fe690bcc-91e0-481c-9abd-9db6a9ae2dd9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:14.610725 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fe690bcc-91e0-481c-9abd-9db6a9ae2dd9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:14.611504 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fe690bcc-91e0-481c-9abd-9db6a9ae2dd9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:14.611974 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fe690bcc-91e0-481c-9abd-9db6a9ae2dd9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:14.641550 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-fe690bcc-91e0-481c-9abd-9db6a9ae2dd9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041845 Nov 20 03:27:14.642135 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 295/509] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:27:14 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:27:14.713837 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-4f569530-398d-4426-b5fe-75dacae84bcd tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Flavor limits 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 03:27:14.714299 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-4f569530-398d-4426-b5fe-75dacae84bcd tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Image limits 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 03:27:14.714735 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-4f569530-398d-4426-b5fe-75dacae84bcd tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Flavor pref 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 03:27:14.715286 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-4f569530-398d-4426-b5fe-75dacae84bcd tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Image pref 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 03:27:14.716197 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-4f569530-398d-4426-b5fe-75dacae84bcd tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 03:27:14.724984 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4f569530-398d-4426-b5fe-75dacae84bcd tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:14.725433 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4f569530-398d-4426-b5fe-75dacae84bcd tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:14.726367 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4f569530-398d-4426-b5fe-75dacae84bcd tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:14.726803 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4f569530-398d-4426-b5fe-75dacae84bcd tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:14.743699 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-4f569530-398d-4426-b5fe-75dacae84bcd tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Getting quotas for project 3619424d1b174797a1d4f1370072ff9f. Resources: {'ram', 'cores', 'instances'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:27:14.747705 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-4f569530-398d-4426-b5fe-75dacae84bcd tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Getting quotas for user 459d890323c24949b698061a926af1ab and project 3619424d1b174797a1d4f1370072ff9f. Resources: {'ram', 'cores', 'instances'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:27:14.758475 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-4f569530-398d-4426-b5fe-75dacae84bcd tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Going to run 1 instances... {{(pid=116114) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 03:27:14.760914 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-4f569530-398d-4426-b5fe-75dacae84bcd tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 03:27:14.809696 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-4f569530-398d-4426-b5fe-75dacae84bcd tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.698799 Nov 20 03:27:14.815371 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 215/510] 10.222.0.37 () {60 vars in 1146 bytes} [Sat Nov 20 03:27:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 20 03:27:14.820729 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-5616f18e-d518-45e9-96d3-dc41a25b781f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:14.821477 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-5616f18e-d518-45e9-96d3-dc41a25b781f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:14.880137 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-5616f18e-d518-45e9-96d3-dc41a25b781f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:14.886938 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-5616f18e-d518-45e9-96d3-dc41a25b781f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1214 microversion: 2.1 time: 0.070268 Nov 20 03:27:14.888044 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 296/511] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:14 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:15.007055 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-adabbd0c-1d2d-4709-89d0-5e1e13e9e107 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:15.008497 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-adabbd0c-1d2d-4709-89d0-5e1e13e9e107 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:15.022148 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-adabbd0c-1d2d-4709-89d0-5e1e13e9e107 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:15.022536 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-adabbd0c-1d2d-4709-89d0-5e1e13e9e107 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:15.023336 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-adabbd0c-1d2d-4709-89d0-5e1e13e9e107 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:15.023763 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-adabbd0c-1d2d-4709-89d0-5e1e13e9e107 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:15.299935 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-adabbd0c-1d2d-4709-89d0-5e1e13e9e107 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:15.309075 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-adabbd0c-1d2d-4709-89d0-5e1e13e9e107 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1266 microversion: 2.1 time: 0.305431 Nov 20 03:27:15.320221 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 216/512] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:15 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1266 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:15.619821 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-47f682cf-9fef-4827-b575-315e4513798c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:15.620442 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-47f682cf-9fef-4827-b575-315e4513798c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:15.628427 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-47f682cf-9fef-4827-b575-315e4513798c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:15.629420 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-47f682cf-9fef-4827-b575-315e4513798c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:15.630394 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-47f682cf-9fef-4827-b575-315e4513798c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:15.630991 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-47f682cf-9fef-4827-b575-315e4513798c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:15.655127 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-82d0733b-68f2-4162-9c51-f1278c7fd678 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:15.656260 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-82d0733b-68f2-4162-9c51-f1278c7fd678 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:15.667876 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-82d0733b-68f2-4162-9c51-f1278c7fd678 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:15.671430 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-82d0733b-68f2-4162-9c51-f1278c7fd678 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:15.683246 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-82d0733b-68f2-4162-9c51-f1278c7fd678 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:15.686690 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-82d0733b-68f2-4162-9c51-f1278c7fd678 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:15.769293 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-82d0733b-68f2-4162-9c51-f1278c7fd678 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119621 Nov 20 03:27:15.770594 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 217/513] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:27:15 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:27:15.819773 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-47f682cf-9fef-4827-b575-315e4513798c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:15.835142 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-47f682cf-9fef-4827-b575-315e4513798c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:15.838083 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-47f682cf-9fef-4827-b575-315e4513798c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:15.842417 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-47f682cf-9fef-4827-b575-315e4513798c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1809 microversion: 2.20 time: 0.229696 Nov 20 03:27:15.857048 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 297/514] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:15 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:27:15.910729 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-355835af-fadc-4ab6-91ed-65d594a2813a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:15.911562 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-355835af-fadc-4ab6-91ed-65d594a2813a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:15.928990 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-355835af-fadc-4ab6-91ed-65d594a2813a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:15.929783 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-355835af-fadc-4ab6-91ed-65d594a2813a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:15.930811 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-355835af-fadc-4ab6-91ed-65d594a2813a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:15.931524 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-355835af-fadc-4ab6-91ed-65d594a2813a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:16.030622 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-355835af-fadc-4ab6-91ed-65d594a2813a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:16.038941 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-355835af-fadc-4ab6-91ed-65d594a2813a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1218 microversion: 2.1 time: 0.134319 Nov 20 03:27:16.039967 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 218/515] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:15 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1218 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:16.326206 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-a98e24ec-2bc9-4bb1-8e1c-47998de253f4 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:16.326819 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-a98e24ec-2bc9-4bb1-8e1c-47998de253f4 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:16.337767 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a98e24ec-2bc9-4bb1-8e1c-47998de253f4 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:16.338468 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a98e24ec-2bc9-4bb1-8e1c-47998de253f4 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:16.339433 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a98e24ec-2bc9-4bb1-8e1c-47998de253f4 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:16.340065 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a98e24ec-2bc9-4bb1-8e1c-47998de253f4 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:16.593762 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a98e24ec-2bc9-4bb1-8e1c-47998de253f4 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:16.607118 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-a98e24ec-2bc9-4bb1-8e1c-47998de253f4 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1266 microversion: 2.1 time: 0.283228 Nov 20 03:27:16.608164 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 298/516] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:16 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1266 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:16.785314 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-02f0d118-64eb-44ba-8ebf-911154726653 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:16.788247 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-02f0d118-64eb-44ba-8ebf-911154726653 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:16.813719 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-02f0d118-64eb-44ba-8ebf-911154726653 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:16.814119 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-02f0d118-64eb-44ba-8ebf-911154726653 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:16.815153 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-02f0d118-64eb-44ba-8ebf-911154726653 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:16.815682 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-02f0d118-64eb-44ba-8ebf-911154726653 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:16.862292 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-97f2e2ac-71a4-4729-b1e1-76c0eabdeead tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:16.864090 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-97f2e2ac-71a4-4729-b1e1-76c0eabdeead tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:16.873930 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-02f0d118-64eb-44ba-8ebf-911154726653 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092438 Nov 20 03:27:16.875007 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 219/517] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:27:16 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:27:16.875568 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-97f2e2ac-71a4-4729-b1e1-76c0eabdeead tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:16.876387 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-97f2e2ac-71a4-4729-b1e1-76c0eabdeead tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:16.877281 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-97f2e2ac-71a4-4729-b1e1-76c0eabdeead tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:16.877823 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-97f2e2ac-71a4-4729-b1e1-76c0eabdeead tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:17.055520 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-87bd65ea-5706-4dd4-b8b0-4c79696c17e5 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:17.056159 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-87bd65ea-5706-4dd4-b8b0-4c79696c17e5 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:17.063557 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-87bd65ea-5706-4dd4-b8b0-4c79696c17e5 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:17.064520 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-87bd65ea-5706-4dd4-b8b0-4c79696c17e5 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:17.065502 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-87bd65ea-5706-4dd4-b8b0-4c79696c17e5 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:17.065932 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-87bd65ea-5706-4dd4-b8b0-4c79696c17e5 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:17.068190 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-97f2e2ac-71a4-4729-b1e1-76c0eabdeead tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:17.077799 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-97f2e2ac-71a4-4729-b1e1-76c0eabdeead tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:17.079308 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-97f2e2ac-71a4-4729-b1e1-76c0eabdeead tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:17.084957 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-97f2e2ac-71a4-4729-b1e1-76c0eabdeead tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1809 microversion: 2.20 time: 0.226574 Nov 20 03:27:17.085529 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 299/518] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:16 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1809 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:27:17.131869 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-87bd65ea-5706-4dd4-b8b0-4c79696c17e5 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:17.140295 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-87bd65ea-5706-4dd4-b8b0-4c79696c17e5 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1218 microversion: 2.1 time: 0.089043 Nov 20 03:27:17.141136 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 220/519] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:17 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:17.625334 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-3fb79a2f-8499-49a8-9465-2002346ad1bf tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:17.626111 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-3fb79a2f-8499-49a8-9465-2002346ad1bf tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:17.635764 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3fb79a2f-8499-49a8-9465-2002346ad1bf tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:17.636254 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3fb79a2f-8499-49a8-9465-2002346ad1bf tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:17.637037 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3fb79a2f-8499-49a8-9465-2002346ad1bf tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:17.638091 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3fb79a2f-8499-49a8-9465-2002346ad1bf tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:17.841466 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-3fb79a2f-8499-49a8-9465-2002346ad1bf tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:17.859426 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-3fb79a2f-8499-49a8-9465-2002346ad1bf tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1266 microversion: 2.1 time: 0.238392 Nov 20 03:27:17.878596 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 300/520] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:17 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:17.888444 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-a86b71fd-a9e4-4adf-8e64-77c3d7cde5da tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:17.890298 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-a86b71fd-a9e4-4adf-8e64-77c3d7cde5da tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:17.897869 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a86b71fd-a9e4-4adf-8e64-77c3d7cde5da tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:17.898906 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a86b71fd-a9e4-4adf-8e64-77c3d7cde5da tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:17.900241 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a86b71fd-a9e4-4adf-8e64-77c3d7cde5da tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:17.900681 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a86b71fd-a9e4-4adf-8e64-77c3d7cde5da tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:17.931524 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-a86b71fd-a9e4-4adf-8e64-77c3d7cde5da tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047911 Nov 20 03:27:17.932189 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 221/521] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:27:17 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:27:18.107755 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-225b0604-38b1-433f-8464-a07d85ea53ee tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:18.108727 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-225b0604-38b1-433f-8464-a07d85ea53ee tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:18.115367 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-225b0604-38b1-433f-8464-a07d85ea53ee tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:18.115856 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-225b0604-38b1-433f-8464-a07d85ea53ee tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:18.116642 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-225b0604-38b1-433f-8464-a07d85ea53ee tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:18.117081 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-225b0604-38b1-433f-8464-a07d85ea53ee tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:18.157714 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-bdd8b6b1-08a8-477d-bdbc-95846ac97bd0 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:18.159309 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-bdd8b6b1-08a8-477d-bdbc-95846ac97bd0 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:18.167228 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bdd8b6b1-08a8-477d-bdbc-95846ac97bd0 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:18.168178 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bdd8b6b1-08a8-477d-bdbc-95846ac97bd0 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:18.170173 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bdd8b6b1-08a8-477d-bdbc-95846ac97bd0 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:18.170828 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bdd8b6b1-08a8-477d-bdbc-95846ac97bd0 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:18.247308 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-bdd8b6b1-08a8-477d-bdbc-95846ac97bd0 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:18.255261 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-bdd8b6b1-08a8-477d-bdbc-95846ac97bd0 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1218 microversion: 2.1 time: 0.101213 Nov 20 03:27:18.255848 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 222/522] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:18 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:18.283280 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-225b0604-38b1-433f-8464-a07d85ea53ee tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:18.292099 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-225b0604-38b1-433f-8464-a07d85ea53ee tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:18.294235 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-225b0604-38b1-433f-8464-a07d85ea53ee tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:18.295463 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-225b0604-38b1-433f-8464-a07d85ea53ee tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1809 microversion: 2.20 time: 0.192590 Nov 20 03:27:18.296051 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 301/523] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:18 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:27:18.889017 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-e39ae452-65c8-4517-b23b-4420d909fd36 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:18.889017 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-e39ae452-65c8-4517-b23b-4420d909fd36 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:18.897606 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e39ae452-65c8-4517-b23b-4420d909fd36 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:18.898427 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e39ae452-65c8-4517-b23b-4420d909fd36 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:18.904227 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e39ae452-65c8-4517-b23b-4420d909fd36 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:18.905169 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e39ae452-65c8-4517-b23b-4420d909fd36 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:18.946315 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-d23e3411-98cd-4b51-9780-3ccbd8bdf04e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:18.948081 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-d23e3411-98cd-4b51-9780-3ccbd8bdf04e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:18.956417 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d23e3411-98cd-4b51-9780-3ccbd8bdf04e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:18.957106 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d23e3411-98cd-4b51-9780-3ccbd8bdf04e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:18.958216 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d23e3411-98cd-4b51-9780-3ccbd8bdf04e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:18.958842 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d23e3411-98cd-4b51-9780-3ccbd8bdf04e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:18.995967 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-d23e3411-98cd-4b51-9780-3ccbd8bdf04e tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055976 Nov 20 03:27:18.999867 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 302/524] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:27:18 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:27:19.005004 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-5fd8d2b0-65b9-4f38-a9ee-1d007af7c2dc tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-449732165", "imageRef": "e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0", "flavorRef": "452"}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:27:19.062015 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-e39ae452-65c8-4517-b23b-4420d909fd36 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:19.065367 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.network.neutron [None req-5fd8d2b0-65b9-4f38-a9ee-1d007af7c2dc tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] validate_networks() for None {{(pid=116113) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 03:27:19.075498 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-e39ae452-65c8-4517-b23b-4420d909fd36 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1266 microversion: 2.1 time: 0.192506 Nov 20 03:27:19.076300 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 223/525] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:18 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:19.272868 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-63e0898b-ce21-49a7-b790-7793ca3767b8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:19.273480 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-63e0898b-ce21-49a7-b790-7793ca3767b8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:19.284059 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-63e0898b-ce21-49a7-b790-7793ca3767b8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:19.284794 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-63e0898b-ce21-49a7-b790-7793ca3767b8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:19.285762 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-63e0898b-ce21-49a7-b790-7793ca3767b8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:19.286356 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-63e0898b-ce21-49a7-b790-7793ca3767b8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:19.367837 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-63e0898b-ce21-49a7-b790-7793ca3767b8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:19.376289 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-63e0898b-ce21-49a7-b790-7793ca3767b8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1218 microversion: 2.1 time: 0.107728 Nov 20 03:27:19.389241 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 224/526] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:19 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:19.393850 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-6127963f-199c-467a-9352-d362e15461b6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:19.394678 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-6127963f-199c-467a-9352-d362e15461b6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:19.402842 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6127963f-199c-467a-9352-d362e15461b6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:19.408596 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6127963f-199c-467a-9352-d362e15461b6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:19.411144 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6127963f-199c-467a-9352-d362e15461b6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:19.411659 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6127963f-199c-467a-9352-d362e15461b6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:19.428418 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-5fd8d2b0-65b9-4f38-a9ee-1d007af7c2dc tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Flavor limits 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 03:27:19.428850 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-5fd8d2b0-65b9-4f38-a9ee-1d007af7c2dc tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Image limits 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 03:27:19.429332 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-5fd8d2b0-65b9-4f38-a9ee-1d007af7c2dc tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Flavor pref 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 03:27:19.429824 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-5fd8d2b0-65b9-4f38-a9ee-1d007af7c2dc tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Image pref 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 03:27:19.430330 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-5fd8d2b0-65b9-4f38-a9ee-1d007af7c2dc tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 03:27:19.450704 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5fd8d2b0-65b9-4f38-a9ee-1d007af7c2dc tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:19.451548 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5fd8d2b0-65b9-4f38-a9ee-1d007af7c2dc tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:19.452713 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5fd8d2b0-65b9-4f38-a9ee-1d007af7c2dc tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:19.453451 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5fd8d2b0-65b9-4f38-a9ee-1d007af7c2dc tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:19.502813 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-5fd8d2b0-65b9-4f38-a9ee-1d007af7c2dc tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Getting quotas for project bf913c6c0c784651a7867d309c36b408. Resources: {'ram', 'cores', 'instances'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:27:19.513558 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-5fd8d2b0-65b9-4f38-a9ee-1d007af7c2dc tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Getting quotas for user 8be02be5f25342d38e5fa007e1c6491e and project bf913c6c0c784651a7867d309c36b408. Resources: {'ram', 'cores', 'instances'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:27:19.525333 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-5fd8d2b0-65b9-4f38-a9ee-1d007af7c2dc tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Going to run 1 instances... {{(pid=116113) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 03:27:19.528285 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-5fd8d2b0-65b9-4f38-a9ee-1d007af7c2dc tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 03:27:19.600185 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-5fd8d2b0-65b9-4f38-a9ee-1d007af7c2dc tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598882 Nov 20 03:27:19.600962 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 303/527] 10.222.0.37 () {60 vars in 1146 bytes} [Sat Nov 20 03:27:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 03:27:19.611540 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-2fffd076-fb17-435b-9203-c9648848257d tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:19.612185 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-2fffd076-fb17-435b-9203-c9648848257d tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:19.630359 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-6127963f-199c-467a-9352-d362e15461b6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:19.648712 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-6127963f-199c-467a-9352-d362e15461b6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:19.650609 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-6127963f-199c-467a-9352-d362e15461b6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:19.651985 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-6127963f-199c-467a-9352-d362e15461b6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1809 microversion: 2.20 time: 0.272598 Nov 20 03:27:19.653654 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 225/528] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:19 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1809 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:27:19.681213 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-2fffd076-fb17-435b-9203-c9648848257d tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be02be5f25342d38e5fa007e1c6491e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf913c6c0c784651a7867d309c36b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:19.689483 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-2fffd076-fb17-435b-9203-c9648848257d tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 200 len: 1214 microversion: 2.1 time: 0.081580 Nov 20 03:27:19.690250 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 304/529] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:19 2021] GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:20.009250 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-b1455b15-e1e5-4bd7-add9-4c7f0122d9e7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:20.011037 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-b1455b15-e1e5-4bd7-add9-4c7f0122d9e7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:20.019005 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b1455b15-e1e5-4bd7-add9-4c7f0122d9e7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:20.019468 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b1455b15-e1e5-4bd7-add9-4c7f0122d9e7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:20.020416 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b1455b15-e1e5-4bd7-add9-4c7f0122d9e7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:20.020836 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b1455b15-e1e5-4bd7-add9-4c7f0122d9e7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:20.054622 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-b1455b15-e1e5-4bd7-add9-4c7f0122d9e7 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049585 Nov 20 03:27:20.055998 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 226/530] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:27:20 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:27:20.092243 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-fca2670c-8b56-4b6a-8786-41311566eaef tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:20.092859 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-fca2670c-8b56-4b6a-8786-41311566eaef tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:20.099120 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fca2670c-8b56-4b6a-8786-41311566eaef tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:20.099574 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fca2670c-8b56-4b6a-8786-41311566eaef tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:20.100388 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fca2670c-8b56-4b6a-8786-41311566eaef tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:20.100825 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fca2670c-8b56-4b6a-8786-41311566eaef tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:20.233889 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-fca2670c-8b56-4b6a-8786-41311566eaef tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:20.241401 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-fca2670c-8b56-4b6a-8786-41311566eaef tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1266 microversion: 2.1 time: 0.152841 Nov 20 03:27:20.241966 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 305/531] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:20 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:20.396285 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-dacf4c90-6e88-4834-a889-3e3498ef1555 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:20.396898 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-dacf4c90-6e88-4834-a889-3e3498ef1555 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:20.404352 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dacf4c90-6e88-4834-a889-3e3498ef1555 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:20.404352 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dacf4c90-6e88-4834-a889-3e3498ef1555 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:20.404637 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dacf4c90-6e88-4834-a889-3e3498ef1555 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:20.405046 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dacf4c90-6e88-4834-a889-3e3498ef1555 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:20.467349 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-dacf4c90-6e88-4834-a889-3e3498ef1555 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:20.480176 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-dacf4c90-6e88-4834-a889-3e3498ef1555 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1218 microversion: 2.1 time: 0.087415 Nov 20 03:27:20.481097 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 227/532] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:20 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:20.670824 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-bd32049e-bee0-4b2e-b848-f15c30d874d4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:20.671542 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-bd32049e-bee0-4b2e-b848-f15c30d874d4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:20.677805 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bd32049e-bee0-4b2e-b848-f15c30d874d4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:20.678390 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bd32049e-bee0-4b2e-b848-f15c30d874d4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:20.679404 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bd32049e-bee0-4b2e-b848-f15c30d874d4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:20.679978 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bd32049e-bee0-4b2e-b848-f15c30d874d4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:20.706500 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-4bbb9724-0756-4712-ac8e-2fc1eeaba6f0 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:20.707217 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-4bbb9724-0756-4712-ac8e-2fc1eeaba6f0 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:20.716959 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4bbb9724-0756-4712-ac8e-2fc1eeaba6f0 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:20.720099 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4bbb9724-0756-4712-ac8e-2fc1eeaba6f0 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:20.721011 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4bbb9724-0756-4712-ac8e-2fc1eeaba6f0 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:20.721522 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4bbb9724-0756-4712-ac8e-2fc1eeaba6f0 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:20.803206 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-4bbb9724-0756-4712-ac8e-2fc1eeaba6f0 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be02be5f25342d38e5fa007e1c6491e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf913c6c0c784651a7867d309c36b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:20.827470 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-4bbb9724-0756-4712-ac8e-2fc1eeaba6f0 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 200 len: 1218 microversion: 2.1 time: 0.114114 Nov 20 03:27:20.829654 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 228/533] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:20 2021] GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 1218 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:20.877585 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-bd32049e-bee0-4b2e-b848-f15c30d874d4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:20.886136 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-bd32049e-bee0-4b2e-b848-f15c30d874d4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:20.888216 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-bd32049e-bee0-4b2e-b848-f15c30d874d4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:20.889378 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-bd32049e-bee0-4b2e-b848-f15c30d874d4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1809 microversion: 2.20 time: 0.222918 Nov 20 03:27:20.889941 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 306/534] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:20 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:27:21.066372 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-644dafbb-49c2-4a16-9b34-d8957a385770 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:21.067941 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-644dafbb-49c2-4a16-9b34-d8957a385770 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:21.085358 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-644dafbb-49c2-4a16-9b34-d8957a385770 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:21.085945 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-644dafbb-49c2-4a16-9b34-d8957a385770 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:21.086969 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-644dafbb-49c2-4a16-9b34-d8957a385770 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:21.087903 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-644dafbb-49c2-4a16-9b34-d8957a385770 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:21.159865 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-644dafbb-49c2-4a16-9b34-d8957a385770 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097149 Nov 20 03:27:21.160565 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 229/535] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:27:21 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:27:21.261132 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-a1e21352-edcc-48b1-83b5-c994e44b6d12 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:21.263215 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-a1e21352-edcc-48b1-83b5-c994e44b6d12 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:21.270443 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a1e21352-edcc-48b1-83b5-c994e44b6d12 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:21.270982 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a1e21352-edcc-48b1-83b5-c994e44b6d12 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:21.272660 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a1e21352-edcc-48b1-83b5-c994e44b6d12 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:21.273113 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a1e21352-edcc-48b1-83b5-c994e44b6d12 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:21.421255 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a1e21352-edcc-48b1-83b5-c994e44b6d12 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:21.428699 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-a1e21352-edcc-48b1-83b5-c994e44b6d12 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1266 microversion: 2.1 time: 0.171492 Nov 20 03:27:21.429274 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 307/536] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:21 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:21.501561 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-8f752a51-05da-41df-854b-9d192fbcf5de tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:21.502179 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-8f752a51-05da-41df-854b-9d192fbcf5de tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:21.508357 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8f752a51-05da-41df-854b-9d192fbcf5de tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:21.508809 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8f752a51-05da-41df-854b-9d192fbcf5de tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:21.509597 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8f752a51-05da-41df-854b-9d192fbcf5de tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:21.510034 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8f752a51-05da-41df-854b-9d192fbcf5de tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:21.569347 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-8f752a51-05da-41df-854b-9d192fbcf5de tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:21.584642 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-8f752a51-05da-41df-854b-9d192fbcf5de tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1218 microversion: 2.1 time: 0.088042 Nov 20 03:27:21.585227 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 230/537] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:21 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:21.847421 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ae1244a2-f8df-476d-9f84-360cc79b7ad7 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:21.848616 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ae1244a2-f8df-476d-9f84-360cc79b7ad7 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:21.854477 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ae1244a2-f8df-476d-9f84-360cc79b7ad7 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:21.854931 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ae1244a2-f8df-476d-9f84-360cc79b7ad7 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:21.855709 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ae1244a2-f8df-476d-9f84-360cc79b7ad7 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:21.856736 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ae1244a2-f8df-476d-9f84-360cc79b7ad7 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:21.908904 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-c80656ab-5d8d-4ce8-8e0e-2e1847daf90f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:21.909830 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-c80656ab-5d8d-4ce8-8e0e-2e1847daf90f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:21.916264 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-ae1244a2-f8df-476d-9f84-360cc79b7ad7 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be02be5f25342d38e5fa007e1c6491e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf913c6c0c784651a7867d309c36b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:21.925252 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ae1244a2-f8df-476d-9f84-360cc79b7ad7 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 200 len: 1218 microversion: 2.1 time: 0.082685 Nov 20 03:27:21.929676 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c80656ab-5d8d-4ce8-8e0e-2e1847daf90f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:21.930206 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c80656ab-5d8d-4ce8-8e0e-2e1847daf90f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:21.931220 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c80656ab-5d8d-4ce8-8e0e-2e1847daf90f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:21.931905 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c80656ab-5d8d-4ce8-8e0e-2e1847daf90f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:21.933614 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 308/538] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:21 2021] GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:22.069184 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-c80656ab-5d8d-4ce8-8e0e-2e1847daf90f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:22.078399 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-c80656ab-5d8d-4ce8-8e0e-2e1847daf90f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:22.080024 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-c80656ab-5d8d-4ce8-8e0e-2e1847daf90f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:22.081249 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-c80656ab-5d8d-4ce8-8e0e-2e1847daf90f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1809 microversion: 2.20 time: 0.176080 Nov 20 03:27:22.081810 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 231/539] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:21 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:27:22.171978 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-f15a75f1-4bee-41a8-acf3-e766b49e281b tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:22.173418 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f15a75f1-4bee-41a8-acf3-e766b49e281b tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:22.179183 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f15a75f1-4bee-41a8-acf3-e766b49e281b tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:22.179642 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f15a75f1-4bee-41a8-acf3-e766b49e281b tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:22.180450 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f15a75f1-4bee-41a8-acf3-e766b49e281b tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:22.180890 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f15a75f1-4bee-41a8-acf3-e766b49e281b tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:22.213232 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-f15a75f1-4bee-41a8-acf3-e766b49e281b tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046313 Nov 20 03:27:22.213798 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 309/540] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:27:22 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:27:22.445845 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-4c26b09c-f25f-44db-a0cc-d39325adb6a7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:22.446705 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-4c26b09c-f25f-44db-a0cc-d39325adb6a7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:22.453383 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4c26b09c-f25f-44db-a0cc-d39325adb6a7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:22.453863 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4c26b09c-f25f-44db-a0cc-d39325adb6a7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:22.454643 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4c26b09c-f25f-44db-a0cc-d39325adb6a7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:22.455082 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4c26b09c-f25f-44db-a0cc-d39325adb6a7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:22.601978 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ea77005f-9bd5-4ad7-9409-7220082d7ef8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:22.603189 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ea77005f-9bd5-4ad7-9409-7220082d7ef8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:22.610071 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ea77005f-9bd5-4ad7-9409-7220082d7ef8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:22.610516 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ea77005f-9bd5-4ad7-9409-7220082d7ef8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:22.611321 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ea77005f-9bd5-4ad7-9409-7220082d7ef8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:22.611749 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ea77005f-9bd5-4ad7-9409-7220082d7ef8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:22.613157 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-4c26b09c-f25f-44db-a0cc-d39325adb6a7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:22.622182 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-4c26b09c-f25f-44db-a0cc-d39325adb6a7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1266 microversion: 2.1 time: 0.179395 Nov 20 03:27:22.623298 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 232/541] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:22 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:22.674189 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-ea77005f-9bd5-4ad7-9409-7220082d7ef8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:22.681583 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ea77005f-9bd5-4ad7-9409-7220082d7ef8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1218 microversion: 2.1 time: 0.083425 Nov 20 03:27:22.682172 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 310/542] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:22 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:22.942286 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-4e1357d8-bb2a-4a9e-8f32-f11e34376749 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:22.943026 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-4e1357d8-bb2a-4a9e-8f32-f11e34376749 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:22.949720 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4e1357d8-bb2a-4a9e-8f32-f11e34376749 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:22.950207 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4e1357d8-bb2a-4a9e-8f32-f11e34376749 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:22.951005 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4e1357d8-bb2a-4a9e-8f32-f11e34376749 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:22.951423 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4e1357d8-bb2a-4a9e-8f32-f11e34376749 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:23.022482 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-4e1357d8-bb2a-4a9e-8f32-f11e34376749 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be02be5f25342d38e5fa007e1c6491e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf913c6c0c784651a7867d309c36b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:23.048581 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-4e1357d8-bb2a-4a9e-8f32-f11e34376749 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 200 len: 1218 microversion: 2.1 time: 0.109968 Nov 20 03:27:23.050483 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 233/543] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:22 2021] GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:23.099452 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-93fc7d57-4914-43c1-82f7-8f357b12c6de tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:23.100283 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-93fc7d57-4914-43c1-82f7-8f357b12c6de tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:23.112822 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-93fc7d57-4914-43c1-82f7-8f357b12c6de tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:23.113734 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-93fc7d57-4914-43c1-82f7-8f357b12c6de tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:23.114722 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-93fc7d57-4914-43c1-82f7-8f357b12c6de tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:23.115347 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-93fc7d57-4914-43c1-82f7-8f357b12c6de tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:23.224599 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-6861c2bd-4978-4ca4-a3d7-d4596acbe4b6 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:23.225569 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-6861c2bd-4978-4ca4-a3d7-d4596acbe4b6 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:23.232477 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6861c2bd-4978-4ca4-a3d7-d4596acbe4b6 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:23.233047 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6861c2bd-4978-4ca4-a3d7-d4596acbe4b6 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:23.234039 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6861c2bd-4978-4ca4-a3d7-d4596acbe4b6 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:23.234748 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6861c2bd-4978-4ca4-a3d7-d4596acbe4b6 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:23.274069 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-6861c2bd-4978-4ca4-a3d7-d4596acbe4b6 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053293 Nov 20 03:27:23.275053 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 234/544] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:27:23 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:27:23.289160 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-93fc7d57-4914-43c1-82f7-8f357b12c6de tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:23.297408 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-93fc7d57-4914-43c1-82f7-8f357b12c6de tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:23.298904 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-93fc7d57-4914-43c1-82f7-8f357b12c6de tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:23.300208 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-93fc7d57-4914-43c1-82f7-8f357b12c6de tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1809 microversion: 2.20 time: 0.204626 Nov 20 03:27:23.300980 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 311/545] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:23 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1809 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:27:23.639975 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-ffec655d-3e4c-49a8-a652-0c2b014344fb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:23.640901 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-ffec655d-3e4c-49a8-a652-0c2b014344fb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:23.647303 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ffec655d-3e4c-49a8-a652-0c2b014344fb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:23.647768 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ffec655d-3e4c-49a8-a652-0c2b014344fb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:23.648547 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ffec655d-3e4c-49a8-a652-0c2b014344fb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:23.649087 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ffec655d-3e4c-49a8-a652-0c2b014344fb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:23.698245 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-032a3816-c813-4ee2-9d61-d8a829977a9a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:23.699031 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-032a3816-c813-4ee2-9d61-d8a829977a9a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:23.706951 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-032a3816-c813-4ee2-9d61-d8a829977a9a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:23.707492 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-032a3816-c813-4ee2-9d61-d8a829977a9a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:23.708324 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-032a3816-c813-4ee2-9d61-d8a829977a9a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:23.708775 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-032a3816-c813-4ee2-9d61-d8a829977a9a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:23.782220 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-032a3816-c813-4ee2-9d61-d8a829977a9a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:23.794100 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-032a3816-c813-4ee2-9d61-d8a829977a9a tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1218 microversion: 2.1 time: 0.098791 Nov 20 03:27:23.795124 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 312/546] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:23 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:23.814427 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-ffec655d-3e4c-49a8-a652-0c2b014344fb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:23.826147 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-ffec655d-3e4c-49a8-a652-0c2b014344fb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1266 microversion: 2.1 time: 0.191497 Nov 20 03:27:23.827083 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 235/547] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:23 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:24.067150 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-0aeac304-8c78-4ece-8564-79521211917e tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:24.067764 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-0aeac304-8c78-4ece-8564-79521211917e tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:24.073724 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0aeac304-8c78-4ece-8564-79521211917e tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:24.074208 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0aeac304-8c78-4ece-8564-79521211917e tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:24.075018 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0aeac304-8c78-4ece-8564-79521211917e tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:24.075463 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0aeac304-8c78-4ece-8564-79521211917e tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:24.136631 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-0aeac304-8c78-4ece-8564-79521211917e tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be02be5f25342d38e5fa007e1c6491e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf913c6c0c784651a7867d309c36b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:24.144335 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-0aeac304-8c78-4ece-8564-79521211917e tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 200 len: 1218 microversion: 2.1 time: 0.081051 Nov 20 03:27:24.150072 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 313/548] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:24 2021] GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:24.286006 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-e150069e-de6d-41ff-8332-39bb9b52c01d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:24.287034 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-e150069e-de6d-41ff-8332-39bb9b52c01d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:24.293025 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e150069e-de6d-41ff-8332-39bb9b52c01d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:24.293714 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e150069e-de6d-41ff-8332-39bb9b52c01d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:24.295450 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e150069e-de6d-41ff-8332-39bb9b52c01d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:24.296175 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e150069e-de6d-41ff-8332-39bb9b52c01d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:24.326914 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-cb6e270e-f60d-42ee-a9fa-46595ed4cc26 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:24.327136 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-e150069e-de6d-41ff-8332-39bb9b52c01d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045154 Nov 20 03:27:24.327694 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-cb6e270e-f60d-42ee-a9fa-46595ed4cc26 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:24.331319 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 236/549] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:27:24 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:27:24.334312 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cb6e270e-f60d-42ee-a9fa-46595ed4cc26 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:24.334850 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cb6e270e-f60d-42ee-a9fa-46595ed4cc26 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:24.335728 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cb6e270e-f60d-42ee-a9fa-46595ed4cc26 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:24.336269 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cb6e270e-f60d-42ee-a9fa-46595ed4cc26 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:24.496515 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-cb6e270e-f60d-42ee-a9fa-46595ed4cc26 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:24.504928 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-cb6e270e-f60d-42ee-a9fa-46595ed4cc26 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:24.506266 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-cb6e270e-f60d-42ee-a9fa-46595ed4cc26 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:24.507449 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-cb6e270e-f60d-42ee-a9fa-46595ed4cc26 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1809 microversion: 2.20 time: 0.190428 Nov 20 03:27:24.508105 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 314/550] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:24 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:27:24.813419 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-09c20aea-8cf5-4e1c-8ee9-ff196c3aba8e tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:24.813419 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-09c20aea-8cf5-4e1c-8ee9-ff196c3aba8e tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:24.819395 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-09c20aea-8cf5-4e1c-8ee9-ff196c3aba8e tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:24.820078 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-09c20aea-8cf5-4e1c-8ee9-ff196c3aba8e tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:24.821059 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-09c20aea-8cf5-4e1c-8ee9-ff196c3aba8e tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:24.821499 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-09c20aea-8cf5-4e1c-8ee9-ff196c3aba8e tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:24.844517 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-07107988-3afd-47c9-96fd-58a826a76152 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:24.845197 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-07107988-3afd-47c9-96fd-58a826a76152 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:24.859087 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-07107988-3afd-47c9-96fd-58a826a76152 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:24.859866 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-07107988-3afd-47c9-96fd-58a826a76152 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:24.861193 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-07107988-3afd-47c9-96fd-58a826a76152 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:24.861193 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-07107988-3afd-47c9-96fd-58a826a76152 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:24.884895 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-09c20aea-8cf5-4e1c-8ee9-ff196c3aba8e tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:24.898744 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-09c20aea-8cf5-4e1c-8ee9-ff196c3aba8e tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1218 microversion: 2.1 time: 0.092022 Nov 20 03:27:24.900290 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 237/551] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:24 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:25.005574 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-07107988-3afd-47c9-96fd-58a826a76152 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:25.012914 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-07107988-3afd-47c9-96fd-58a826a76152 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1266 microversion: 2.1 time: 0.173013 Nov 20 03:27:25.014135 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 315/552] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:24 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:25.160860 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-38dfd30a-4d4d-4643-a159-f17e34f99c8e tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:25.161581 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-38dfd30a-4d4d-4643-a159-f17e34f99c8e tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:25.167453 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-38dfd30a-4d4d-4643-a159-f17e34f99c8e tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:25.167928 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-38dfd30a-4d4d-4643-a159-f17e34f99c8e tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:25.168703 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-38dfd30a-4d4d-4643-a159-f17e34f99c8e tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:25.169137 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-38dfd30a-4d4d-4643-a159-f17e34f99c8e tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:25.235512 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-38dfd30a-4d4d-4643-a159-f17e34f99c8e tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be02be5f25342d38e5fa007e1c6491e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf913c6c0c784651a7867d309c36b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:25.242818 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-38dfd30a-4d4d-4643-a159-f17e34f99c8e tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 200 len: 1218 microversion: 2.1 time: 0.085577 Nov 20 03:27:25.243373 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 238/553] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:25 2021] GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:25.338522 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ee8755d0-6b36-4f5b-a442-0d8def1249e8 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:25.339506 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ee8755d0-6b36-4f5b-a442-0d8def1249e8 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:25.345794 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ee8755d0-6b36-4f5b-a442-0d8def1249e8 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:25.346423 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ee8755d0-6b36-4f5b-a442-0d8def1249e8 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:25.347425 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ee8755d0-6b36-4f5b-a442-0d8def1249e8 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:25.348156 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ee8755d0-6b36-4f5b-a442-0d8def1249e8 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:25.378910 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ee8755d0-6b36-4f5b-a442-0d8def1249e8 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044103 Nov 20 03:27:25.379471 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 316/554] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:27:25 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:27:25.526427 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-cfa72e31-6758-4272-a5ff-25034fc0d512 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:25.527015 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-cfa72e31-6758-4272-a5ff-25034fc0d512 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:25.533314 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cfa72e31-6758-4272-a5ff-25034fc0d512 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:25.533765 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cfa72e31-6758-4272-a5ff-25034fc0d512 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:25.534546 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cfa72e31-6758-4272-a5ff-25034fc0d512 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:25.534985 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cfa72e31-6758-4272-a5ff-25034fc0d512 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:25.675729 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-cfa72e31-6758-4272-a5ff-25034fc0d512 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:25.684181 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-cfa72e31-6758-4272-a5ff-25034fc0d512 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:25.685736 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-cfa72e31-6758-4272-a5ff-25034fc0d512 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:25.686894 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-cfa72e31-6758-4272-a5ff-25034fc0d512 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1809 microversion: 2.20 time: 0.164268 Nov 20 03:27:25.687454 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 239/555] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:25 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:27:25.914982 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-e4e1ffea-d73f-4823-9062-5552f68fad5c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:25.915690 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-e4e1ffea-d73f-4823-9062-5552f68fad5c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:25.922182 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e4e1ffea-d73f-4823-9062-5552f68fad5c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:25.922737 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e4e1ffea-d73f-4823-9062-5552f68fad5c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:25.923604 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e4e1ffea-d73f-4823-9062-5552f68fad5c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:25.924135 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e4e1ffea-d73f-4823-9062-5552f68fad5c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:25.984313 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-e4e1ffea-d73f-4823-9062-5552f68fad5c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:25.991571 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-e4e1ffea-d73f-4823-9062-5552f68fad5c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1218 microversion: 2.1 time: 0.080262 Nov 20 03:27:25.992165 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 317/556] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:25 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:26.030615 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-f70152d4-4091-447a-a8dd-865dfffee310 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:26.031229 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-f70152d4-4091-447a-a8dd-865dfffee310 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:26.037579 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f70152d4-4091-447a-a8dd-865dfffee310 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:26.038028 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f70152d4-4091-447a-a8dd-865dfffee310 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:26.038804 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f70152d4-4091-447a-a8dd-865dfffee310 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:26.039241 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f70152d4-4091-447a-a8dd-865dfffee310 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:26.172405 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-f70152d4-4091-447a-a8dd-865dfffee310 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:26.179971 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-f70152d4-4091-447a-a8dd-865dfffee310 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1266 microversion: 2.1 time: 0.153565 Nov 20 03:27:26.180534 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 240/557] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:26 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:26.259761 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-d18af586-41cb-4201-bad7-20d02cf4da85 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:26.260392 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-d18af586-41cb-4201-bad7-20d02cf4da85 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:26.266843 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d18af586-41cb-4201-bad7-20d02cf4da85 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:26.267299 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d18af586-41cb-4201-bad7-20d02cf4da85 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:26.268146 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d18af586-41cb-4201-bad7-20d02cf4da85 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:26.268590 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d18af586-41cb-4201-bad7-20d02cf4da85 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:26.326997 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-d18af586-41cb-4201-bad7-20d02cf4da85 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be02be5f25342d38e5fa007e1c6491e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf913c6c0c784651a7867d309c36b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:26.334458 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-d18af586-41cb-4201-bad7-20d02cf4da85 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 200 len: 1218 microversion: 2.1 time: 0.078266 Nov 20 03:27:26.335019 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 318/558] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:26 2021] GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:26.391251 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-0994b924-729b-46bb-b52d-3f93331353be tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:26.392426 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-0994b924-729b-46bb-b52d-3f93331353be tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:26.398536 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0994b924-729b-46bb-b52d-3f93331353be tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:26.399060 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0994b924-729b-46bb-b52d-3f93331353be tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:26.399954 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0994b924-729b-46bb-b52d-3f93331353be tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:26.400459 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0994b924-729b-46bb-b52d-3f93331353be tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:26.429676 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-0994b924-729b-46bb-b52d-3f93331353be tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042720 Nov 20 03:27:26.430335 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 241/559] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:27:26 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:27:26.704233 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-914858e7-cfb5-46e5-a43e-16ee3d1eb342 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:26.704764 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-914858e7-cfb5-46e5-a43e-16ee3d1eb342 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:26.711443 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-914858e7-cfb5-46e5-a43e-16ee3d1eb342 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:26.711940 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-914858e7-cfb5-46e5-a43e-16ee3d1eb342 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:26.712738 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-914858e7-cfb5-46e5-a43e-16ee3d1eb342 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:26.713176 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-914858e7-cfb5-46e5-a43e-16ee3d1eb342 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:26.845869 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-914858e7-cfb5-46e5-a43e-16ee3d1eb342 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:26.854467 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-914858e7-cfb5-46e5-a43e-16ee3d1eb342 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:26.856015 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-914858e7-cfb5-46e5-a43e-16ee3d1eb342 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:26.857759 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-914858e7-cfb5-46e5-a43e-16ee3d1eb342 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1809 microversion: 2.20 time: 0.157410 Nov 20 03:27:26.858363 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 319/560] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:26 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:27:27.008591 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-1d490aaa-0d85-4917-b17f-5fe45dffa345 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:27.009119 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-1d490aaa-0d85-4917-b17f-5fe45dffa345 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:27.015219 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1d490aaa-0d85-4917-b17f-5fe45dffa345 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:27.015687 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1d490aaa-0d85-4917-b17f-5fe45dffa345 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:27.016486 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1d490aaa-0d85-4917-b17f-5fe45dffa345 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:27.016917 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1d490aaa-0d85-4917-b17f-5fe45dffa345 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:27.075014 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-1d490aaa-0d85-4917-b17f-5fe45dffa345 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:27.082291 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-1d490aaa-0d85-4917-b17f-5fe45dffa345 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1218 microversion: 2.1 time: 0.077428 Nov 20 03:27:27.082851 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 242/561] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:27 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:27.196597 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-5b693b26-d1b8-4437-b0d3-2b5d0d3a8055 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:27.197271 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-5b693b26-d1b8-4437-b0d3-2b5d0d3a8055 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:27.203600 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5b693b26-d1b8-4437-b0d3-2b5d0d3a8055 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:27.204075 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5b693b26-d1b8-4437-b0d3-2b5d0d3a8055 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:27.204863 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5b693b26-d1b8-4437-b0d3-2b5d0d3a8055 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:27.205303 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5b693b26-d1b8-4437-b0d3-2b5d0d3a8055 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:27.345579 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-5b693b26-d1b8-4437-b0d3-2b5d0d3a8055 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:27.350287 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-2f260f4d-455b-4ad2-aabd-b60ad0c0aec1 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:27.350902 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-2f260f4d-455b-4ad2-aabd-b60ad0c0aec1 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:27.353286 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-5b693b26-d1b8-4437-b0d3-2b5d0d3a8055 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1266 microversion: 2.1 time: 0.160352 Nov 20 03:27:27.353848 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 320/562] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:27 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:27.357599 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2f260f4d-455b-4ad2-aabd-b60ad0c0aec1 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:27.358121 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2f260f4d-455b-4ad2-aabd-b60ad0c0aec1 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:27.358971 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2f260f4d-455b-4ad2-aabd-b60ad0c0aec1 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:27.359481 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2f260f4d-455b-4ad2-aabd-b60ad0c0aec1 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:27.419361 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-2f260f4d-455b-4ad2-aabd-b60ad0c0aec1 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be02be5f25342d38e5fa007e1c6491e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf913c6c0c784651a7867d309c36b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:27.426952 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-2f260f4d-455b-4ad2-aabd-b60ad0c0aec1 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 200 len: 1218 microversion: 2.1 time: 0.080531 Nov 20 03:27:27.427630 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 243/563] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:27 2021] GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:27.441965 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-f3eaf30c-a6d7-4230-a782-0487cc593c81 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:27.443052 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f3eaf30c-a6d7-4230-a782-0487cc593c81 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:27.449079 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f3eaf30c-a6d7-4230-a782-0487cc593c81 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:27.449535 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f3eaf30c-a6d7-4230-a782-0487cc593c81 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:27.450313 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f3eaf30c-a6d7-4230-a782-0487cc593c81 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:27.451233 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f3eaf30c-a6d7-4230-a782-0487cc593c81 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:27.480836 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-f3eaf30c-a6d7-4230-a782-0487cc593c81 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043867 Nov 20 03:27:27.481419 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 321/564] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:27:27 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:27:27.876727 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-e7606836-ea1a-42cf-b150-20db7ce8bcb3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:27.877338 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-e7606836-ea1a-42cf-b150-20db7ce8bcb3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:27.884502 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e7606836-ea1a-42cf-b150-20db7ce8bcb3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:27.885246 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e7606836-ea1a-42cf-b150-20db7ce8bcb3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:27.886651 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e7606836-ea1a-42cf-b150-20db7ce8bcb3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:27.887088 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e7606836-ea1a-42cf-b150-20db7ce8bcb3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:28.026421 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-e7606836-ea1a-42cf-b150-20db7ce8bcb3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:28.035424 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-e7606836-ea1a-42cf-b150-20db7ce8bcb3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:28.036953 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-e7606836-ea1a-42cf-b150-20db7ce8bcb3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:28.038109 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-e7606836-ea1a-42cf-b150-20db7ce8bcb3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1809 microversion: 2.20 time: 0.165637 Nov 20 03:27:28.038869 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 244/565] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:27 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:27:28.100208 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-912e0070-6724-449a-a55d-157c1ab518c4 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:28.100820 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-912e0070-6724-449a-a55d-157c1ab518c4 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:28.107471 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-912e0070-6724-449a-a55d-157c1ab518c4 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:28.107941 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-912e0070-6724-449a-a55d-157c1ab518c4 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:28.108719 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-912e0070-6724-449a-a55d-157c1ab518c4 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:28.109430 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-912e0070-6724-449a-a55d-157c1ab518c4 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:28.171133 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-912e0070-6724-449a-a55d-157c1ab518c4 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:28.178448 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-912e0070-6724-449a-a55d-157c1ab518c4 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1218 microversion: 2.1 time: 0.082632 Nov 20 03:27:28.179004 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 322/566] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:28 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:28.371527 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-7763ec17-2f2d-4a38-b0a6-ba2ab804adf2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:28.372166 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-7763ec17-2f2d-4a38-b0a6-ba2ab804adf2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:28.378958 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7763ec17-2f2d-4a38-b0a6-ba2ab804adf2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:28.379412 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7763ec17-2f2d-4a38-b0a6-ba2ab804adf2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:28.380227 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7763ec17-2f2d-4a38-b0a6-ba2ab804adf2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:28.380665 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7763ec17-2f2d-4a38-b0a6-ba2ab804adf2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:28.443439 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-7e391cc4-7824-4184-9e20-75d866cddc09 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:28.444160 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-7e391cc4-7824-4184-9e20-75d866cddc09 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:28.450527 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7e391cc4-7824-4184-9e20-75d866cddc09 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:28.450986 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7e391cc4-7824-4184-9e20-75d866cddc09 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:28.451761 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7e391cc4-7824-4184-9e20-75d866cddc09 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:28.452223 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7e391cc4-7824-4184-9e20-75d866cddc09 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:28.518205 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-7e391cc4-7824-4184-9e20-75d866cddc09 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be02be5f25342d38e5fa007e1c6491e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf913c6c0c784651a7867d309c36b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:28.525366 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-7e391cc4-7824-4184-9e20-75d866cddc09 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 200 len: 1218 microversion: 2.1 time: 0.085537 Nov 20 03:27:28.525943 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 323/567] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:28 2021] GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:28.533149 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-84d32409-9c12-451b-8ebc-3e8d18a3f756 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:28.534260 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-84d32409-9c12-451b-8ebc-3e8d18a3f756 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:28.540146 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-84d32409-9c12-451b-8ebc-3e8d18a3f756 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:28.540598 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-84d32409-9c12-451b-8ebc-3e8d18a3f756 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:28.541395 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-84d32409-9c12-451b-8ebc-3e8d18a3f756 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:28.541841 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-84d32409-9c12-451b-8ebc-3e8d18a3f756 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:28.544845 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-7763ec17-2f2d-4a38-b0a6-ba2ab804adf2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:28.552305 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-7763ec17-2f2d-4a38-b0a6-ba2ab804adf2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1266 microversion: 2.1 time: 0.185222 Nov 20 03:27:28.552908 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 245/568] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:28 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:28.572903 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-84d32409-9c12-451b-8ebc-3e8d18a3f756 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045090 Nov 20 03:27:28.573667 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 324/569] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:27:28 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:27:29.056885 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-846813a4-5fa8-4b37-a0df-59e2c23dec1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:29.057485 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-846813a4-5fa8-4b37-a0df-59e2c23dec1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:29.063652 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-846813a4-5fa8-4b37-a0df-59e2c23dec1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:29.064169 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-846813a4-5fa8-4b37-a0df-59e2c23dec1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:29.065077 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-846813a4-5fa8-4b37-a0df-59e2c23dec1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:29.065545 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-846813a4-5fa8-4b37-a0df-59e2c23dec1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:29.196332 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-252f0867-29f3-4e3b-8347-6370442f6040 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:29.196858 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-252f0867-29f3-4e3b-8347-6370442f6040 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:29.203534 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-252f0867-29f3-4e3b-8347-6370442f6040 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:29.204020 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-252f0867-29f3-4e3b-8347-6370442f6040 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:29.204813 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-252f0867-29f3-4e3b-8347-6370442f6040 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:29.205250 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-252f0867-29f3-4e3b-8347-6370442f6040 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:29.208975 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-846813a4-5fa8-4b37-a0df-59e2c23dec1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:29.218594 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-846813a4-5fa8-4b37-a0df-59e2c23dec1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:29.220730 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-846813a4-5fa8-4b37-a0df-59e2c23dec1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:29.222274 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-846813a4-5fa8-4b37-a0df-59e2c23dec1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1809 microversion: 2.20 time: 0.169117 Nov 20 03:27:29.233838 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 246/570] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:29 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:27:29.274067 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-252f0867-29f3-4e3b-8347-6370442f6040 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:29.284908 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-252f0867-29f3-4e3b-8347-6370442f6040 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1210 microversion: 2.1 time: 0.092609 Nov 20 03:27:29.285780 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 325/571] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:29 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:29.542254 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-a810b426-052c-40ba-a833-7d262d063918 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:29.543849 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-a810b426-052c-40ba-a833-7d262d063918 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:29.551621 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a810b426-052c-40ba-a833-7d262d063918 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:29.552106 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a810b426-052c-40ba-a833-7d262d063918 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:29.552900 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a810b426-052c-40ba-a833-7d262d063918 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:29.553341 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a810b426-052c-40ba-a833-7d262d063918 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:29.569241 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-560c447a-dc66-4832-8c5f-750327d4d914 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:29.569948 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-560c447a-dc66-4832-8c5f-750327d4d914 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:29.577144 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-560c447a-dc66-4832-8c5f-750327d4d914 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:29.577641 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-560c447a-dc66-4832-8c5f-750327d4d914 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:29.578472 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-560c447a-dc66-4832-8c5f-750327d4d914 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:29.578911 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-560c447a-dc66-4832-8c5f-750327d4d914 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:29.616308 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-a810b426-052c-40ba-a833-7d262d063918 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be02be5f25342d38e5fa007e1c6491e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf913c6c0c784651a7867d309c36b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:29.623714 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-a810b426-052c-40ba-a833-7d262d063918 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 200 len: 1210 microversion: 2.1 time: 0.085201 Nov 20 03:27:29.624474 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 247/572] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:29 2021] GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:29.629181 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-d05fab7a-c4c4-4c9b-9de5-553005657b08 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:29.630359 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-d05fab7a-c4c4-4c9b-9de5-553005657b08 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:29.636926 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d05fab7a-c4c4-4c9b-9de5-553005657b08 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:29.637383 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d05fab7a-c4c4-4c9b-9de5-553005657b08 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:29.638698 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d05fab7a-c4c4-4c9b-9de5-553005657b08 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:29.639135 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d05fab7a-c4c4-4c9b-9de5-553005657b08 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:29.668916 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-d05fab7a-c4c4-4c9b-9de5-553005657b08 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043364 Nov 20 03:27:29.669541 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 248/573] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:27:29 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:27:29.713963 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-560c447a-dc66-4832-8c5f-750327d4d914 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:29.721868 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-560c447a-dc66-4832-8c5f-750327d4d914 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1266 microversion: 2.1 time: 0.156351 Nov 20 03:27:29.722434 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 326/574] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:29 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:30.241086 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-588734d2-713d-4a7a-99ad-1dc7a03c2704 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:30.241842 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-588734d2-713d-4a7a-99ad-1dc7a03c2704 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:30.249457 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-588734d2-713d-4a7a-99ad-1dc7a03c2704 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:30.251656 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-588734d2-713d-4a7a-99ad-1dc7a03c2704 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:30.255749 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-588734d2-713d-4a7a-99ad-1dc7a03c2704 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:30.256610 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-588734d2-713d-4a7a-99ad-1dc7a03c2704 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:30.302352 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-16135c3e-dc1a-44fc-8326-1ffca6b4013c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:30.303072 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-16135c3e-dc1a-44fc-8326-1ffca6b4013c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:30.309387 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-16135c3e-dc1a-44fc-8326-1ffca6b4013c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:30.310366 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-16135c3e-dc1a-44fc-8326-1ffca6b4013c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:30.311159 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-16135c3e-dc1a-44fc-8326-1ffca6b4013c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:30.311991 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-16135c3e-dc1a-44fc-8326-1ffca6b4013c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:30.419941 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-16135c3e-dc1a-44fc-8326-1ffca6b4013c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:30.427234 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-16135c3e-dc1a-44fc-8326-1ffca6b4013c tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1272 microversion: 2.1 time: 0.128971 Nov 20 03:27:30.427838 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 327/575] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:30 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1272 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:30.515364 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-588734d2-713d-4a7a-99ad-1dc7a03c2704 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:30.524319 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-588734d2-713d-4a7a-99ad-1dc7a03c2704 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:30.525832 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-588734d2-713d-4a7a-99ad-1dc7a03c2704 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:30.526991 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-588734d2-713d-4a7a-99ad-1dc7a03c2704 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1809 microversion: 2.20 time: 0.289842 Nov 20 03:27:30.527551 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 249/576] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:30 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1809 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:27:30.641184 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-0b9c77f8-532d-4152-8553-882b43f8519f tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:30.641821 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-0b9c77f8-532d-4152-8553-882b43f8519f tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:30.648151 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0b9c77f8-532d-4152-8553-882b43f8519f tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:30.648602 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0b9c77f8-532d-4152-8553-882b43f8519f tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:30.649379 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0b9c77f8-532d-4152-8553-882b43f8519f tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:30.649818 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0b9c77f8-532d-4152-8553-882b43f8519f tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:30.680646 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-8a3de639-6853-4110-a9a1-642d797a500a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:30.681777 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-8a3de639-6853-4110-a9a1-642d797a500a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:30.688285 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8a3de639-6853-4110-a9a1-642d797a500a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:30.688740 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8a3de639-6853-4110-a9a1-642d797a500a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:30.689560 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8a3de639-6853-4110-a9a1-642d797a500a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:30.689999 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8a3de639-6853-4110-a9a1-642d797a500a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:30.717374 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-0b9c77f8-532d-4152-8553-882b43f8519f tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be02be5f25342d38e5fa007e1c6491e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf913c6c0c784651a7867d309c36b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:30.719774 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-8a3de639-6853-4110-a9a1-642d797a500a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042912 Nov 20 03:27:30.720597 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 250/577] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:27:30 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 03:27:30.726338 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-0b9c77f8-532d-4152-8553-882b43f8519f tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 200 len: 1266 microversion: 2.1 time: 0.089245 Nov 20 03:27:30.726907 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 328/578] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:30 2021] GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:30.754607 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-2435f142-74c7-4e28-841c-5a5b9545d847 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:30.755774 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-2435f142-74c7-4e28-841c-5a5b9545d847 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:30.766284 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2435f142-74c7-4e28-841c-5a5b9545d847 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:30.767199 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2435f142-74c7-4e28-841c-5a5b9545d847 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:30.768618 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2435f142-74c7-4e28-841c-5a5b9545d847 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:30.769066 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2435f142-74c7-4e28-841c-5a5b9545d847 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:31.092883 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-2435f142-74c7-4e28-841c-5a5b9545d847 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:31.102516 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-2435f142-74c7-4e28-841c-5a5b9545d847 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1266 microversion: 2.1 time: 0.367887 Nov 20 03:27:31.103262 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 251/579] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:30 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1266 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:31.450925 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-f34d371a-f2cc-4405-b10b-a2e53dad355f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:31.450925 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f34d371a-f2cc-4405-b10b-a2e53dad355f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:31.469693 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f34d371a-f2cc-4405-b10b-a2e53dad355f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:31.476900 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f34d371a-f2cc-4405-b10b-a2e53dad355f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:31.477849 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f34d371a-f2cc-4405-b10b-a2e53dad355f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:31.478306 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f34d371a-f2cc-4405-b10b-a2e53dad355f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:31.547810 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-6cd18d19-b63e-4269-8067-72b0e12949f2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:31.549872 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-6cd18d19-b63e-4269-8067-72b0e12949f2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:31.562416 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6cd18d19-b63e-4269-8067-72b0e12949f2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:31.563488 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6cd18d19-b63e-4269-8067-72b0e12949f2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:31.564744 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6cd18d19-b63e-4269-8067-72b0e12949f2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:31.565477 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6cd18d19-b63e-4269-8067-72b0e12949f2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:32.069356 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-f34d371a-f2cc-4405-b10b-a2e53dad355f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:32.069903 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-6cd18d19-b63e-4269-8067-72b0e12949f2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:32.081305 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-f34d371a-f2cc-4405-b10b-a2e53dad355f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1314 microversion: 2.1 time: 0.638831 Nov 20 03:27:32.082607 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 329/580] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:31 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1314 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:32.084823 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-6cd18d19-b63e-4269-8067-72b0e12949f2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:32.086967 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-6cd18d19-b63e-4269-8067-72b0e12949f2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:32.088190 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-9f4463ff-fde2-4c22-96c2-918035da1b5a tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:32.088332 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-6cd18d19-b63e-4269-8067-72b0e12949f2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1809 microversion: 2.20 time: 0.547108 Nov 20 03:27:32.089071 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-9f4463ff-fde2-4c22-96c2-918035da1b5a tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:32.089190 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 252/581] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:31 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1809 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:27:32.096108 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9f4463ff-fde2-4c22-96c2-918035da1b5a tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:32.096812 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9f4463ff-fde2-4c22-96c2-918035da1b5a tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:32.098320 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9f4463ff-fde2-4c22-96c2-918035da1b5a tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:32.098761 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9f4463ff-fde2-4c22-96c2-918035da1b5a tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:32.122386 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-fb159881-4fd4-4d62-8497-9ae21ca98ef2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:32.123170 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-fb159881-4fd4-4d62-8497-9ae21ca98ef2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:32.134304 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fb159881-4fd4-4d62-8497-9ae21ca98ef2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:32.143380 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fb159881-4fd4-4d62-8497-9ae21ca98ef2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:32.144422 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fb159881-4fd4-4d62-8497-9ae21ca98ef2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:32.145988 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fb159881-4fd4-4d62-8497-9ae21ca98ef2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:32.201653 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9f4463ff-fde2-4c22-96c2-918035da1b5a tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be02be5f25342d38e5fa007e1c6491e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf913c6c0c784651a7867d309c36b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:32.213261 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-9f4463ff-fde2-4c22-96c2-918035da1b5a tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 200 len: 1272 microversion: 2.1 time: 0.129390 Nov 20 03:27:32.224194 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 330/582] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:32 2021] GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 1272 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:32.536289 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-fb159881-4fd4-4d62-8497-9ae21ca98ef2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:32.543900 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-fb159881-4fd4-4d62-8497-9ae21ca98ef2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1266 microversion: 2.1 time: 0.426577 Nov 20 03:27:32.555950 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 253/583] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:32 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1266 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:32.822474 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-649d12a4-76df-496b-9786-afe369009f1f req-9032d397-d2fb-4820-956f-19d9841dc539 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bda5a290-2779-45d2-b7a6-fd5996c1f4cc", "tag": "cc1c0e14-645b-47e4-8bfb-ee637a3d46e0"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:27:32.824348 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:27:32.824348 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:27:32.832770 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-649d12a4-76df-496b-9786-afe369009f1f req-9032d397-d2fb-4820-956f-19d9841dc539 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:32.833812 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-649d12a4-76df-496b-9786-afe369009f1f req-9032d397-d2fb-4820-956f-19d9841dc539 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:32.849541 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-649d12a4-76df-496b-9786-afe369009f1f req-9032d397-d2fb-4820-956f-19d9841dc539 service nova] Creating event network-changed:cc1c0e14-645b-47e4-8bfb-ee637a3d46e0 for instance bda5a290-2779-45d2-b7a6-fd5996c1f4cc on hv-cinder-81803 Nov 20 03:27:32.854898 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-649d12a4-76df-496b-9786-afe369009f1f req-9032d397-d2fb-4820-956f-19d9841dc539 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035936 Nov 20 03:27:32.855641 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 331/584] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:27:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:27:33.096105 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-f84a6151-d23d-44da-b36b-dad633da7d5b req-eda7648b-c808-40a3-9c72-b93fca68ea35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa0309e3-7fd9-4042-abd0-2d4a6e44946e", "tag": "de016cfa-e54d-49de-908a-9d8edb413893"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:27:33.097878 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:27:33.097878 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:27:33.099597 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-a03edd7d-fdd2-48e7-b8bf-2f5079ce27ea tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:33.101141 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-a03edd7d-fdd2-48e7-b8bf-2f5079ce27ea tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:33.111506 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a03edd7d-fdd2-48e7-b8bf-2f5079ce27ea tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:33.112349 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a03edd7d-fdd2-48e7-b8bf-2f5079ce27ea tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:33.113330 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a03edd7d-fdd2-48e7-b8bf-2f5079ce27ea tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:33.113601 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-f84a6151-d23d-44da-b36b-dad633da7d5b req-eda7648b-c808-40a3-9c72-b93fca68ea35 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:33.114049 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-f84a6151-d23d-44da-b36b-dad633da7d5b req-eda7648b-c808-40a3-9c72-b93fca68ea35 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:33.114263 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a03edd7d-fdd2-48e7-b8bf-2f5079ce27ea tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:33.129423 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-f84a6151-d23d-44da-b36b-dad633da7d5b req-eda7648b-c808-40a3-9c72-b93fca68ea35 service nova] Creating event network-changed:de016cfa-e54d-49de-908a-9d8edb413893 for instance aa0309e3-7fd9-4042-abd0-2d4a6e44946e on hv-cinder-81803 Nov 20 03:27:33.134808 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-f84a6151-d23d-44da-b36b-dad633da7d5b req-eda7648b-c808-40a3-9c72-b93fca68ea35 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042434 Nov 20 03:27:33.136071 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 254/585] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:27:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:27:33.145928 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-06dffa95-04e6-43df-9af6-efe2a6fe4da6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:33.149601 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-06dffa95-04e6-43df-9af6-efe2a6fe4da6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:33.162910 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-06dffa95-04e6-43df-9af6-efe2a6fe4da6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:33.163659 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-06dffa95-04e6-43df-9af6-efe2a6fe4da6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:33.164706 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-06dffa95-04e6-43df-9af6-efe2a6fe4da6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:33.165332 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-06dffa95-04e6-43df-9af6-efe2a6fe4da6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:33.542878 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a03edd7d-fdd2-48e7-b8bf-2f5079ce27ea tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:33.550549 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-a03edd7d-fdd2-48e7-b8bf-2f5079ce27ea tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1314 microversion: 2.1 time: 0.455981 Nov 20 03:27:33.551115 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 332/586] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:33 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:33.556044 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-6a864c79-19c8-4b1f-beb1-06bfba6a7aea tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:33.556902 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-6a864c79-19c8-4b1f-beb1-06bfba6a7aea tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:33.563766 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6a864c79-19c8-4b1f-beb1-06bfba6a7aea tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:33.564261 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6a864c79-19c8-4b1f-beb1-06bfba6a7aea tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:33.565059 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6a864c79-19c8-4b1f-beb1-06bfba6a7aea tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:33.565496 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6a864c79-19c8-4b1f-beb1-06bfba6a7aea tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:33.582844 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-06dffa95-04e6-43df-9af6-efe2a6fe4da6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:33.591183 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-06dffa95-04e6-43df-9af6-efe2a6fe4da6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:33.591342 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-6a864c79-19c8-4b1f-beb1-06bfba6a7aea tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Going to try to terminate instance {{(pid=116113) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 03:27:33.592947 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-06dffa95-04e6-43df-9af6-efe2a6fe4da6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:33.594201 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-06dffa95-04e6-43df-9af6-efe2a6fe4da6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1809 microversion: 2.20 time: 0.456875 Nov 20 03:27:33.594862 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 255/587] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:33 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1809 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:27:33.603367 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-334d8489-fe3d-49b7-8d55-3b675aded823 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:33.604180 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-334d8489-fe3d-49b7-8d55-3b675aded823 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:33.613991 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-334d8489-fe3d-49b7-8d55-3b675aded823 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:33.614723 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-334d8489-fe3d-49b7-8d55-3b675aded823 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:33.615517 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-334d8489-fe3d-49b7-8d55-3b675aded823 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:33.615986 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-334d8489-fe3d-49b7-8d55-3b675aded823 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:33.714245 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-6a864c79-19c8-4b1f-beb1-06bfba6a7aea tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "DELETE /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 204 len: 0 microversion: 2.1 time: 0.161204 Nov 20 03:27:33.715222 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 333/588] 10.222.0.37 () {58 vars in 1238 bytes} [Sat Nov 20 03:27:33 2021] DELETE /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 03:27:33.721430 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-4250b5d8-ed1f-4131-a473-e0202818f9a9 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:33.722170 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-4250b5d8-ed1f-4131-a473-e0202818f9a9 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:33.729205 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4250b5d8-ed1f-4131-a473-e0202818f9a9 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:33.729379 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4250b5d8-ed1f-4131-a473-e0202818f9a9 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:33.730531 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4250b5d8-ed1f-4131-a473-e0202818f9a9 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:33.731249 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4250b5d8-ed1f-4131-a473-e0202818f9a9 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:33.858994 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-334d8489-fe3d-49b7-8d55-3b675aded823 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be02be5f25342d38e5fa007e1c6491e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf913c6c0c784651a7867d309c36b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:33.871003 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-334d8489-fe3d-49b7-8d55-3b675aded823 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 200 len: 1314 microversion: 2.1 time: 0.271016 Nov 20 03:27:33.872913 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 256/589] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:33 2021] GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:33.877426 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-8b653971-fae3-4b61-9655-a974ec2f0b70 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:33.878114 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-8b653971-fae3-4b61-9655-a974ec2f0b70 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:33.884525 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8b653971-fae3-4b61-9655-a974ec2f0b70 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:33.885161 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8b653971-fae3-4b61-9655-a974ec2f0b70 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:33.885953 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8b653971-fae3-4b61-9655-a974ec2f0b70 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:33.886446 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8b653971-fae3-4b61-9655-a974ec2f0b70 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:34.019234 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-4250b5d8-ed1f-4131-a473-e0202818f9a9 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:34.029335 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-4250b5d8-ed1f-4131-a473-e0202818f9a9 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1266 microversion: 2.1 time: 0.310899 Nov 20 03:27:34.029951 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 334/590] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:33 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1266 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:34.131583 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-8b653971-fae3-4b61-9655-a974ec2f0b70 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:34.139820 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-8b653971-fae3-4b61-9655-a974ec2f0b70 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1508 microversion: 2.1 time: 0.265850 Nov 20 03:27:34.158619 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 257/591] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:33 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1508 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:34.570061 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-394f37ed-fe15-4bc1-be95-b8c25d961c03 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:34.570663 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-394f37ed-fe15-4bc1-be95-b8c25d961c03 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:34.579048 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-394f37ed-fe15-4bc1-be95-b8c25d961c03 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:34.579503 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-394f37ed-fe15-4bc1-be95-b8c25d961c03 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:34.580329 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-394f37ed-fe15-4bc1-be95-b8c25d961c03 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:34.580768 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-394f37ed-fe15-4bc1-be95-b8c25d961c03 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:34.617276 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-22d79b70-39f8-42db-a923-726a9154bca0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:34.617907 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-22d79b70-39f8-42db-a923-726a9154bca0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:34.624647 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-22d79b70-39f8-42db-a923-726a9154bca0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:34.625099 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-22d79b70-39f8-42db-a923-726a9154bca0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:34.625909 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-22d79b70-39f8-42db-a923-726a9154bca0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:34.626342 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-22d79b70-39f8-42db-a923-726a9154bca0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:34.762301 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-394f37ed-fe15-4bc1-be95-b8c25d961c03 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:34.773239 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-394f37ed-fe15-4bc1-be95-b8c25d961c03 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1314 microversion: 2.1 time: 0.206725 Nov 20 03:27:34.773778 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 335/592] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:34 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:34.808979 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-22d79b70-39f8-42db-a923-726a9154bca0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:34.818774 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-22d79b70-39f8-42db-a923-726a9154bca0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:34.820249 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-22d79b70-39f8-42db-a923-726a9154bca0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:34.821520 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-22d79b70-39f8-42db-a923-726a9154bca0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1809 microversion: 2.20 time: 0.208245 Nov 20 03:27:34.822125 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 258/593] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:34 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1809 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:27:34.888979 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-1208cf31-e20f-47ab-a8a0-1aa9720f2d47 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:34.889685 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-1208cf31-e20f-47ab-a8a0-1aa9720f2d47 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:34.896098 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1208cf31-e20f-47ab-a8a0-1aa9720f2d47 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:34.896542 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1208cf31-e20f-47ab-a8a0-1aa9720f2d47 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:34.897326 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1208cf31-e20f-47ab-a8a0-1aa9720f2d47 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:34.897757 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1208cf31-e20f-47ab-a8a0-1aa9720f2d47 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:35.031201 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-1208cf31-e20f-47ab-a8a0-1aa9720f2d47 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be02be5f25342d38e5fa007e1c6491e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf913c6c0c784651a7867d309c36b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:35.039040 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-1208cf31-e20f-47ab-a8a0-1aa9720f2d47 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 200 len: 1314 microversion: 2.1 time: 0.153602 Nov 20 03:27:35.039615 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 336/594] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:34 2021] GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:35.045449 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-c67ef49d-acc7-4556-9aae-4fbc3c4eefe3 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:35.046072 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-c67ef49d-acc7-4556-9aae-4fbc3c4eefe3 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:35.051986 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c67ef49d-acc7-4556-9aae-4fbc3c4eefe3 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:35.052432 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c67ef49d-acc7-4556-9aae-4fbc3c4eefe3 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:35.053195 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c67ef49d-acc7-4556-9aae-4fbc3c4eefe3 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:35.053624 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c67ef49d-acc7-4556-9aae-4fbc3c4eefe3 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:35.165632 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-56498c48-3197-443d-8d3b-0402fddbb257 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:35.166340 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-56498c48-3197-443d-8d3b-0402fddbb257 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:35.172800 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-56498c48-3197-443d-8d3b-0402fddbb257 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:35.173246 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-56498c48-3197-443d-8d3b-0402fddbb257 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:35.174026 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-56498c48-3197-443d-8d3b-0402fddbb257 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:35.174462 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-56498c48-3197-443d-8d3b-0402fddbb257 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:35.188248 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-c67ef49d-acc7-4556-9aae-4fbc3c4eefe3 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:35.195514 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-c67ef49d-acc7-4556-9aae-4fbc3c4eefe3 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1266 microversion: 2.1 time: 0.154092 Nov 20 03:27:35.196120 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 259/595] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:35 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:35.305235 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-56498c48-3197-443d-8d3b-0402fddbb257 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:35.313316 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-56498c48-3197-443d-8d3b-0402fddbb257 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1508 microversion: 2.1 time: 0.151253 Nov 20 03:27:35.313902 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 337/596] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:35 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:35.769787 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-951f73ee-edfc-45d2-a897-e241ee25fad9 req-0f10149b-45b1-408e-9f8c-16cd61e10c3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f64dd34e-277a-4033-8330-d0dd481d287c", "name": "network-vif-plugged", "status": "completed", "tag": "243add17-6449-4a77-8663-2a184bd82457"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:27:35.771682 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:27:35.771682 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:27:35.779560 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-951f73ee-edfc-45d2-a897-e241ee25fad9 req-0f10149b-45b1-408e-9f8c-16cd61e10c3f service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:35.780036 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-951f73ee-edfc-45d2-a897-e241ee25fad9 req-0f10149b-45b1-408e-9f8c-16cd61e10c3f service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:35.790841 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-f1e388f8-35e1-4679-9e51-ce5f13d71b8d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:35.791371 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-951f73ee-edfc-45d2-a897-e241ee25fad9 req-0f10149b-45b1-408e-9f8c-16cd61e10c3f service nova] Creating event network-vif-plugged:243add17-6449-4a77-8663-2a184bd82457 for instance f64dd34e-277a-4033-8330-d0dd481d287c on hv-cinder-81803 Nov 20 03:27:35.791570 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f1e388f8-35e1-4679-9e51-ce5f13d71b8d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:35.796052 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-951f73ee-edfc-45d2-a897-e241ee25fad9 req-0f10149b-45b1-408e-9f8c-16cd61e10c3f service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029880 Nov 20 03:27:35.796641 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 260/597] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:27:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:27:35.799465 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f1e388f8-35e1-4679-9e51-ce5f13d71b8d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:35.799954 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f1e388f8-35e1-4679-9e51-ce5f13d71b8d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:35.800869 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f1e388f8-35e1-4679-9e51-ce5f13d71b8d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:35.801251 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f1e388f8-35e1-4679-9e51-ce5f13d71b8d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:35.840449 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-79ae400f-aca2-4f92-882c-67b6590f72c8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:35.841827 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-79ae400f-aca2-4f92-882c-67b6590f72c8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:35.848461 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-79ae400f-aca2-4f92-882c-67b6590f72c8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:35.848909 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-79ae400f-aca2-4f92-882c-67b6590f72c8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:35.849702 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-79ae400f-aca2-4f92-882c-67b6590f72c8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:35.850131 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-79ae400f-aca2-4f92-882c-67b6590f72c8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:35.983562 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-f1e388f8-35e1-4679-9e51-ce5f13d71b8d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:35.991094 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-f1e388f8-35e1-4679-9e51-ce5f13d71b8d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1314 microversion: 2.1 time: 0.204477 Nov 20 03:27:35.991656 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 338/598] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:35 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:36.027272 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-79ae400f-aca2-4f92-882c-67b6590f72c8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:36.035559 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-79ae400f-aca2-4f92-882c-67b6590f72c8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:36.037141 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-79ae400f-aca2-4f92-882c-67b6590f72c8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:36.038290 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-79ae400f-aca2-4f92-882c-67b6590f72c8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1809 microversion: 2.20 time: 0.202063 Nov 20 03:27:36.038874 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 261/599] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:35 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1809 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:27:36.056120 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-f93a07d5-8a56-4fed-971b-e88d125ebe85 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:36.056755 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f93a07d5-8a56-4fed-971b-e88d125ebe85 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:36.063334 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f93a07d5-8a56-4fed-971b-e88d125ebe85 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:36.063836 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f93a07d5-8a56-4fed-971b-e88d125ebe85 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:36.064845 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f93a07d5-8a56-4fed-971b-e88d125ebe85 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:36.065311 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f93a07d5-8a56-4fed-971b-e88d125ebe85 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:36.198819 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-f93a07d5-8a56-4fed-971b-e88d125ebe85 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be02be5f25342d38e5fa007e1c6491e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf913c6c0c784651a7867d309c36b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:36.208904 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-f93a07d5-8a56-4fed-971b-e88d125ebe85 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 200 len: 1314 microversion: 2.1 time: 0.156394 Nov 20 03:27:36.209652 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 339/600] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:36 2021] GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:36.211883 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-605d2c6a-17f2-4143-aa6f-3c6c0e82a340 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:36.212903 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-605d2c6a-17f2-4143-aa6f-3c6c0e82a340 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:36.221372 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-605d2c6a-17f2-4143-aa6f-3c6c0e82a340 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:36.222969 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-605d2c6a-17f2-4143-aa6f-3c6c0e82a340 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:36.224163 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-605d2c6a-17f2-4143-aa6f-3c6c0e82a340 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:36.224664 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-605d2c6a-17f2-4143-aa6f-3c6c0e82a340 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:36.330636 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-829ba5cb-7723-4617-84ad-23d2ae888b33 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:36.331408 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-829ba5cb-7723-4617-84ad-23d2ae888b33 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:36.337136 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-829ba5cb-7723-4617-84ad-23d2ae888b33 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:36.337592 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-829ba5cb-7723-4617-84ad-23d2ae888b33 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:36.338375 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-829ba5cb-7723-4617-84ad-23d2ae888b33 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:36.338816 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-829ba5cb-7723-4617-84ad-23d2ae888b33 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:36.359571 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-605d2c6a-17f2-4143-aa6f-3c6c0e82a340 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:36.368326 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-605d2c6a-17f2-4143-aa6f-3c6c0e82a340 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1266 microversion: 2.1 time: 0.160316 Nov 20 03:27:36.368999 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 262/601] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:36 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:36.466690 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-829ba5cb-7723-4617-84ad-23d2ae888b33 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:36.474787 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-829ba5cb-7723-4617-84ad-23d2ae888b33 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1508 microversion: 2.1 time: 0.147780 Nov 20 03:27:36.475363 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 340/602] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:36 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:37.008153 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-52216422-2d2d-4b26-a6e5-c2bf3d5d448b tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:37.008787 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-52216422-2d2d-4b26-a6e5-c2bf3d5d448b tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:37.015387 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-52216422-2d2d-4b26-a6e5-c2bf3d5d448b tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:37.015860 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-52216422-2d2d-4b26-a6e5-c2bf3d5d448b tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:37.016637 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-52216422-2d2d-4b26-a6e5-c2bf3d5d448b tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:37.017069 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-52216422-2d2d-4b26-a6e5-c2bf3d5d448b tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:37.056302 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-129f134b-cd3f-4dc2-ac28-d16cb9c9a1ac tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:37.056908 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-129f134b-cd3f-4dc2-ac28-d16cb9c9a1ac tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:37.063911 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-129f134b-cd3f-4dc2-ac28-d16cb9c9a1ac tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:37.064358 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-129f134b-cd3f-4dc2-ac28-d16cb9c9a1ac tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:37.065311 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-129f134b-cd3f-4dc2-ac28-d16cb9c9a1ac tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:37.065744 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-129f134b-cd3f-4dc2-ac28-d16cb9c9a1ac tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:37.182130 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-52216422-2d2d-4b26-a6e5-c2bf3d5d448b tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:37.190510 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-52216422-2d2d-4b26-a6e5-c2bf3d5d448b tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1314 microversion: 2.1 time: 0.186391 Nov 20 03:27:37.191093 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 263/603] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:37 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:37.225169 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-25802a7f-4f03-4753-80f7-093915b7c3d3 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:37.225374 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-129f134b-cd3f-4dc2-ac28-d16cb9c9a1ac tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:37.225809 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-25802a7f-4f03-4753-80f7-093915b7c3d3 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:37.232315 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-25802a7f-4f03-4753-80f7-093915b7c3d3 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:37.232761 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-25802a7f-4f03-4753-80f7-093915b7c3d3 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:37.234014 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-25802a7f-4f03-4753-80f7-093915b7c3d3 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:37.234122 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-129f134b-cd3f-4dc2-ac28-d16cb9c9a1ac tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:37.234448 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-25802a7f-4f03-4753-80f7-093915b7c3d3 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:37.235548 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-129f134b-cd3f-4dc2-ac28-d16cb9c9a1ac tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:37.236727 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-129f134b-cd3f-4dc2-ac28-d16cb9c9a1ac tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1809 microversion: 2.20 time: 0.184124 Nov 20 03:27:37.237560 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 341/604] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:37 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:27:37.369208 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-25802a7f-4f03-4753-80f7-093915b7c3d3 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be02be5f25342d38e5fa007e1c6491e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf913c6c0c784651a7867d309c36b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:37.377061 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-25802a7f-4f03-4753-80f7-093915b7c3d3 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 200 len: 1314 microversion: 2.1 time: 0.155730 Nov 20 03:27:37.377638 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 264/605] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:37 2021] GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:37.385786 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-727b85e8-8a01-409d-a48a-5bae5e68d4f8 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:37.386385 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-727b85e8-8a01-409d-a48a-5bae5e68d4f8 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:37.392224 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-727b85e8-8a01-409d-a48a-5bae5e68d4f8 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:37.392668 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-727b85e8-8a01-409d-a48a-5bae5e68d4f8 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:37.393431 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-727b85e8-8a01-409d-a48a-5bae5e68d4f8 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:37.393860 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-727b85e8-8a01-409d-a48a-5bae5e68d4f8 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:37.492211 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-f676a6b8-f039-4e1b-bf5b-73dec471b97d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:37.492921 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-f676a6b8-f039-4e1b-bf5b-73dec471b97d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:37.498981 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f676a6b8-f039-4e1b-bf5b-73dec471b97d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:37.499515 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f676a6b8-f039-4e1b-bf5b-73dec471b97d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:37.500436 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f676a6b8-f039-4e1b-bf5b-73dec471b97d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:37.500949 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f676a6b8-f039-4e1b-bf5b-73dec471b97d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:37.793426 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-727b85e8-8a01-409d-a48a-5bae5e68d4f8 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:37.801602 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-727b85e8-8a01-409d-a48a-5bae5e68d4f8 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1266 microversion: 2.1 time: 0.419314 Nov 20 03:27:37.802364 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 342/606] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:37 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1266 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:37.859552 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-f676a6b8-f039-4e1b-bf5b-73dec471b97d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:37.867105 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-f676a6b8-f039-4e1b-bf5b-73dec471b97d tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1508 microversion: 2.1 time: 0.378553 Nov 20 03:27:37.867683 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 265/607] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:37 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1508 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:38.207168 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-a4b6620a-24cf-4d5b-a08a-6ef2d5ce72f8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:38.207909 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-a4b6620a-24cf-4d5b-a08a-6ef2d5ce72f8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:38.214631 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a4b6620a-24cf-4d5b-a08a-6ef2d5ce72f8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:38.215213 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a4b6620a-24cf-4d5b-a08a-6ef2d5ce72f8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:38.216839 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a4b6620a-24cf-4d5b-a08a-6ef2d5ce72f8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:38.217279 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a4b6620a-24cf-4d5b-a08a-6ef2d5ce72f8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:38.256859 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-efd8253c-5dcd-446b-9f26-1407592e47cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:38.257436 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-efd8253c-5dcd-446b-9f26-1407592e47cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:38.264036 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-efd8253c-5dcd-446b-9f26-1407592e47cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:38.264506 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-efd8253c-5dcd-446b-9f26-1407592e47cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:38.265279 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-efd8253c-5dcd-446b-9f26-1407592e47cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:38.265710 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-efd8253c-5dcd-446b-9f26-1407592e47cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:38.396246 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a4b6620a-24cf-4d5b-a08a-6ef2d5ce72f8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:38.403695 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-a4b6620a-24cf-4d5b-a08a-6ef2d5ce72f8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1314 microversion: 2.1 time: 0.200226 Nov 20 03:27:38.404381 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 343/608] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:38 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:38.408951 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-2cfbd58b-4fd8-43ad-859e-25c962033f02 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:38.409654 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-2cfbd58b-4fd8-43ad-859e-25c962033f02 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:38.415354 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2cfbd58b-4fd8-43ad-859e-25c962033f02 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:38.415923 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2cfbd58b-4fd8-43ad-859e-25c962033f02 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:38.416772 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2cfbd58b-4fd8-43ad-859e-25c962033f02 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:38.417211 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2cfbd58b-4fd8-43ad-859e-25c962033f02 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:38.439554 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-efd8253c-5dcd-446b-9f26-1407592e47cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:38.448000 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-efd8253c-5dcd-446b-9f26-1407592e47cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:38.449519 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-efd8253c-5dcd-446b-9f26-1407592e47cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:38.451295 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-efd8253c-5dcd-446b-9f26-1407592e47cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1809 microversion: 2.20 time: 0.198739 Nov 20 03:27:38.451878 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 266/609] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:38 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:27:38.543585 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-2cfbd58b-4fd8-43ad-859e-25c962033f02 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be02be5f25342d38e5fa007e1c6491e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf913c6c0c784651a7867d309c36b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:38.551589 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-2cfbd58b-4fd8-43ad-859e-25c962033f02 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 200 len: 1314 microversion: 2.1 time: 0.145395 Nov 20 03:27:38.552541 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 344/610] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:38 2021] GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:38.818138 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-9de7b146-c3f4-48c9-9bbe-b05257db4b97 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:38.818670 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-9de7b146-c3f4-48c9-9bbe-b05257db4b97 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:38.824709 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9de7b146-c3f4-48c9-9bbe-b05257db4b97 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:38.825162 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9de7b146-c3f4-48c9-9bbe-b05257db4b97 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:38.825939 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9de7b146-c3f4-48c9-9bbe-b05257db4b97 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:38.826378 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9de7b146-c3f4-48c9-9bbe-b05257db4b97 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:38.884471 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-a9d5824b-287e-4e50-8118-e387538902f6 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:38.885090 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-a9d5824b-287e-4e50-8118-e387538902f6 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:38.894777 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a9d5824b-287e-4e50-8118-e387538902f6 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:38.895484 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a9d5824b-287e-4e50-8118-e387538902f6 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:38.896693 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a9d5824b-287e-4e50-8118-e387538902f6 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:38.897299 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a9d5824b-287e-4e50-8118-e387538902f6 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:39.006957 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-9de7b146-c3f4-48c9-9bbe-b05257db4b97 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:39.016948 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-9de7b146-c3f4-48c9-9bbe-b05257db4b97 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1454 microversion: 2.1 time: 0.202484 Nov 20 03:27:39.030973 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 267/611] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:38 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1454 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:39.038576 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-aa802a2f-185b-4668-9504-da9e80f329bd tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:39.039186 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-aa802a2f-185b-4668-9504-da9e80f329bd tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:39.047263 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-aa802a2f-185b-4668-9504-da9e80f329bd tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:39.050094 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-aa802a2f-185b-4668-9504-da9e80f329bd tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:39.050962 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-aa802a2f-185b-4668-9504-da9e80f329bd tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:39.051578 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-aa802a2f-185b-4668-9504-da9e80f329bd tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:39.096444 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a9d5824b-287e-4e50-8118-e387538902f6 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:39.112211 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-a9d5824b-287e-4e50-8118-e387538902f6 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1508 microversion: 2.1 time: 0.227051 Nov 20 03:27:39.112987 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 345/612] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:38 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1508 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:39.217396 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-9ce638aa-604f-430b-b577-43f2ed2fd938 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:39.218002 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-9ce638aa-604f-430b-b577-43f2ed2fd938 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:39.224380 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9ce638aa-604f-430b-b577-43f2ed2fd938 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:39.224856 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9ce638aa-604f-430b-b577-43f2ed2fd938 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:39.225627 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9ce638aa-604f-430b-b577-43f2ed2fd938 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:39.226062 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9ce638aa-604f-430b-b577-43f2ed2fd938 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:39.238196 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-aa802a2f-185b-4668-9504-da9e80f329bd tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:39.245546 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-aa802a2f-185b-4668-9504-da9e80f329bd tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1454 microversion: 2.1 time: 0.211388 Nov 20 03:27:39.246264 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 268/613] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:39 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1454 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:39.319922 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.objects.instance [None req-9ce638aa-604f-430b-b577-43f2ed2fd938 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lazy-loading 'services' on Instance uuid 36116e65-2e67-4d18-84c2-d699cae54285 {{(pid=116113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 03:27:39.389429 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-9ce638aa-604f-430b-b577-43f2ed2fd938 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "DELETE /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285/os-volume_attachments/c7e7a531-e26f-48a5-9502-2d3488a9fe1f" status: 202 len: 0 microversion: 2.1 time: 0.176367 Nov 20 03:27:39.390013 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 346/614] 10.222.0.37 () {58 vars in 1415 bytes} [Sat Nov 20 03:27:39 2021] DELETE /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285/os-volume_attachments/c7e7a531-e26f-48a5-9502-2d3488a9fe1f => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 03:27:39.400268 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-ccf065ba-c5f5-468a-b0c3-a70f405a1a09 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:39.401484 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-ccf065ba-c5f5-468a-b0c3-a70f405a1a09 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:39.408805 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ccf065ba-c5f5-468a-b0c3-a70f405a1a09 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:39.409433 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ccf065ba-c5f5-468a-b0c3-a70f405a1a09 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:39.411053 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ccf065ba-c5f5-468a-b0c3-a70f405a1a09 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:39.411491 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ccf065ba-c5f5-468a-b0c3-a70f405a1a09 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:39.422527 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-82219aa3-b9b8-440b-9336-0918ab857793 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:39.423928 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-82219aa3-b9b8-440b-9336-0918ab857793 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:39.431330 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-82219aa3-b9b8-440b-9336-0918ab857793 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:39.432125 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-82219aa3-b9b8-440b-9336-0918ab857793 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:39.440492 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-82219aa3-b9b8-440b-9336-0918ab857793 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:39.441152 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-82219aa3-b9b8-440b-9336-0918ab857793 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:39.458025 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-ccf065ba-c5f5-468a-b0c3-a70f405a1a09 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063594 Nov 20 03:27:39.458890 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 269/615] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:27:39 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:27:39.471306 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-ee7a24ae-59d1-4908-8d8a-59a5550073cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:39.471965 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-ee7a24ae-59d1-4908-8d8a-59a5550073cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:39.483027 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ee7a24ae-59d1-4908-8d8a-59a5550073cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:39.483748 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ee7a24ae-59d1-4908-8d8a-59a5550073cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:39.485817 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ee7a24ae-59d1-4908-8d8a-59a5550073cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:39.486283 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ee7a24ae-59d1-4908-8d8a-59a5550073cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:39.740979 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-82219aa3-b9b8-440b-9336-0918ab857793 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:39.752951 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-82219aa3-b9b8-440b-9336-0918ab857793 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1314 microversion: 2.1 time: 0.336008 Nov 20 03:27:39.756665 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-ee7a24ae-59d1-4908-8d8a-59a5550073cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:39.766352 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 347/616] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:39 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:39.772491 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-ee7a24ae-59d1-4908-8d8a-59a5550073cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:39.777486 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-23de645e-e9ae-4688-90ec-72cc70b87842 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:39.777955 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-ee7a24ae-59d1-4908-8d8a-59a5550073cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:39.781944 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-23de645e-e9ae-4688-90ec-72cc70b87842 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:39.782219 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-ee7a24ae-59d1-4908-8d8a-59a5550073cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1809 microversion: 2.20 time: 0.313673 Nov 20 03:27:39.782906 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 270/617] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:39 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1809 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:27:39.792977 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-23de645e-e9ae-4688-90ec-72cc70b87842 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:39.792977 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-23de645e-e9ae-4688-90ec-72cc70b87842 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:39.792977 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-23de645e-e9ae-4688-90ec-72cc70b87842 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:39.792977 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-23de645e-e9ae-4688-90ec-72cc70b87842 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:40.055870 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-23de645e-e9ae-4688-90ec-72cc70b87842 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be02be5f25342d38e5fa007e1c6491e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf913c6c0c784651a7867d309c36b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:40.063822 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-23de645e-e9ae-4688-90ec-72cc70b87842 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 200 len: 1314 microversion: 2.1 time: 0.295892 Nov 20 03:27:40.064400 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 348/618] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:39 2021] GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:40.129414 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-d9da4f57-21b1-4b81-908a-553c4d591231 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:40.130032 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-d9da4f57-21b1-4b81-908a-553c4d591231 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:40.136520 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d9da4f57-21b1-4b81-908a-553c4d591231 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:40.137000 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d9da4f57-21b1-4b81-908a-553c4d591231 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:40.138176 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d9da4f57-21b1-4b81-908a-553c4d591231 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:40.138963 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d9da4f57-21b1-4b81-908a-553c4d591231 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:40.218308 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-d9da4f57-21b1-4b81-908a-553c4d591231 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:40.228384 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-d9da4f57-21b1-4b81-908a-553c4d591231 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1466 microversion: 2.1 time: 0.102639 Nov 20 03:27:40.229574 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 271/619] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:40 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1466 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:40.259739 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-929e494e-70cd-45ad-af46-6377e05cb39d req-a0f3ab19-bdc4-49a8-a7af-e8a028a86960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "329637be-05e2-4b96-9709-c1b15f8f5f30", "name": "network-vif-deleted", "tag": "ebf8d38e-80de-4df8-9ecf-25de53f3a222"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:27:40.262328 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:27:40.262328 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:27:40.270922 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-929e494e-70cd-45ad-af46-6377e05cb39d req-a0f3ab19-bdc4-49a8-a7af-e8a028a86960 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:40.271392 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-929e494e-70cd-45ad-af46-6377e05cb39d req-a0f3ab19-bdc4-49a8-a7af-e8a028a86960 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:40.283267 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-929e494e-70cd-45ad-af46-6377e05cb39d req-a0f3ab19-bdc4-49a8-a7af-e8a028a86960 service nova] Creating event network-vif-deleted:ebf8d38e-80de-4df8-9ecf-25de53f3a222 for instance 329637be-05e2-4b96-9709-c1b15f8f5f30 on hv-cinder-81803 Nov 20 03:27:40.288437 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-929e494e-70cd-45ad-af46-6377e05cb39d req-a0f3ab19-bdc4-49a8-a7af-e8a028a86960 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034890 Nov 20 03:27:40.289651 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 349/620] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:27:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:27:40.476403 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-d3155976-59ad-4d78-89af-91620ac826e4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:40.477637 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-d3155976-59ad-4d78-89af-91620ac826e4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:40.484974 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d3155976-59ad-4d78-89af-91620ac826e4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:40.485640 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d3155976-59ad-4d78-89af-91620ac826e4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:40.486844 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d3155976-59ad-4d78-89af-91620ac826e4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:40.488006 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d3155976-59ad-4d78-89af-91620ac826e4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:40.529378 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-d3155976-59ad-4d78-89af-91620ac826e4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056863 Nov 20 03:27:40.533243 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 272/621] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:27:40 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:27:40.780612 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-dd87efc7-4948-4577-884c-9a5e3ac8b065 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:40.781364 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-dd87efc7-4948-4577-884c-9a5e3ac8b065 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:40.787755 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dd87efc7-4948-4577-884c-9a5e3ac8b065 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:40.788245 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dd87efc7-4948-4577-884c-9a5e3ac8b065 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:40.789024 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dd87efc7-4948-4577-884c-9a5e3ac8b065 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:40.789459 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dd87efc7-4948-4577-884c-9a5e3ac8b065 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:40.800526 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-3a016660-5d23-4525-8c03-aacaf6ab2a8f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:40.801133 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-3a016660-5d23-4525-8c03-aacaf6ab2a8f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:40.806825 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3a016660-5d23-4525-8c03-aacaf6ab2a8f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:40.807267 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3a016660-5d23-4525-8c03-aacaf6ab2a8f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:40.808067 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3a016660-5d23-4525-8c03-aacaf6ab2a8f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:40.808499 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3a016660-5d23-4525-8c03-aacaf6ab2a8f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:41.096159 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-dd87efc7-4948-4577-884c-9a5e3ac8b065 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:41.112529 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-3a016660-5d23-4525-8c03-aacaf6ab2a8f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:41.119105 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-dd87efc7-4948-4577-884c-9a5e3ac8b065 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1314 microversion: 2.1 time: 0.343145 Nov 20 03:27:41.119707 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 350/622] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:40 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:41.121451 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-3a016660-5d23-4525-8c03-aacaf6ab2a8f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:41.122939 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-3a016660-5d23-4525-8c03-aacaf6ab2a8f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:41.124316 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-3a016660-5d23-4525-8c03-aacaf6ab2a8f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1809 microversion: 2.20 time: 0.327512 Nov 20 03:27:41.135307 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 273/623] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:40 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1809 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:27:41.136475 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-eb20a56b-96d6-4a77-8156-ddba226e886b tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:41.138925 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-eb20a56b-96d6-4a77-8156-ddba226e886b tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:41.147116 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-eb20a56b-96d6-4a77-8156-ddba226e886b tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:41.147570 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-eb20a56b-96d6-4a77-8156-ddba226e886b tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:41.148382 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-eb20a56b-96d6-4a77-8156-ddba226e886b tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:41.148836 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-eb20a56b-96d6-4a77-8156-ddba226e886b tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:41.247145 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-fe3f8362-8a03-44f3-b367-2fc5325e7f87 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:41.247837 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-fe3f8362-8a03-44f3-b367-2fc5325e7f87 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:41.257998 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fe3f8362-8a03-44f3-b367-2fc5325e7f87 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:41.258869 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fe3f8362-8a03-44f3-b367-2fc5325e7f87 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:41.259337 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fe3f8362-8a03-44f3-b367-2fc5325e7f87 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:41.259771 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fe3f8362-8a03-44f3-b367-2fc5325e7f87 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:41.295557 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fe3f8362-8a03-44f3-b367-2fc5325e7f87 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:41.296038 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fe3f8362-8a03-44f3-b367-2fc5325e7f87 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:41.296489 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.objects.instance [None req-fe3f8362-8a03-44f3-b367-2fc5325e7f87 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lazy-loading 'fault' on Instance uuid 329637be-05e2-4b96-9709-c1b15f8f5f30 {{(pid=116114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 03:27:41.392461 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-fe3f8362-8a03-44f3-b367-2fc5325e7f87 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:41.401834 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-fe3f8362-8a03-44f3-b367-2fc5325e7f87 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 200 len: 1312 microversion: 2.1 time: 0.159034 Nov 20 03:27:41.404727 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 274/624] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:41 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:41.463114 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-eb20a56b-96d6-4a77-8156-ddba226e886b tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be02be5f25342d38e5fa007e1c6491e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf913c6c0c784651a7867d309c36b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:41.470313 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-eb20a56b-96d6-4a77-8156-ddba226e886b tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 200 len: 1314 microversion: 2.1 time: 0.348878 Nov 20 03:27:41.470875 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 351/625] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:41 2021] GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:41.541187 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-eb977348-9701-4fa0-a8ca-f2d7d9685cac tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:41.542510 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-eb977348-9701-4fa0-a8ca-f2d7d9685cac tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:41.549212 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-eb977348-9701-4fa0-a8ca-f2d7d9685cac tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:41.549734 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-eb977348-9701-4fa0-a8ca-f2d7d9685cac tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:41.550702 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-eb977348-9701-4fa0-a8ca-f2d7d9685cac tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:41.551362 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-eb977348-9701-4fa0-a8ca-f2d7d9685cac tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:41.592886 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-eb977348-9701-4fa0-a8ca-f2d7d9685cac tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055532 Nov 20 03:27:41.593465 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 275/626] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:27:41 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 03:27:41.768582 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-687013ef-6354-4b5c-9d14-bdf72522292d req-892a196f-c980-4ed3-9cc6-f05bc7fc58c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f64dd34e-277a-4033-8330-d0dd481d287c", "tag": "243add17-6449-4a77-8663-2a184bd82457"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:27:41.770200 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:27:41.770200 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:27:41.778958 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-687013ef-6354-4b5c-9d14-bdf72522292d req-892a196f-c980-4ed3-9cc6-f05bc7fc58c1 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:41.779412 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-687013ef-6354-4b5c-9d14-bdf72522292d req-892a196f-c980-4ed3-9cc6-f05bc7fc58c1 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:41.794478 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-687013ef-6354-4b5c-9d14-bdf72522292d req-892a196f-c980-4ed3-9cc6-f05bc7fc58c1 service nova] Creating event network-changed:243add17-6449-4a77-8663-2a184bd82457 for instance f64dd34e-277a-4033-8330-d0dd481d287c on hv-cinder-81803 Nov 20 03:27:41.799670 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-687013ef-6354-4b5c-9d14-bdf72522292d req-892a196f-c980-4ed3-9cc6-f05bc7fc58c1 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038631 Nov 20 03:27:41.800596 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 352/627] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:27:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:27:41.922889 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-220fbc83-6033-4ff7-acdd-7ff1adf4e79d req-e43290af-e9fb-46d4-b9c1-688ff6911a3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0309e3-7fd9-4042-abd0-2d4a6e44946e", "name": "network-vif-plugged", "status": "completed", "tag": "de016cfa-e54d-49de-908a-9d8edb413893"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:27:41.926959 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:27:41.926959 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:27:41.937591 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-220fbc83-6033-4ff7-acdd-7ff1adf4e79d req-e43290af-e9fb-46d4-b9c1-688ff6911a3d service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:41.938382 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-220fbc83-6033-4ff7-acdd-7ff1adf4e79d req-e43290af-e9fb-46d4-b9c1-688ff6911a3d service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:41.950378 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-220fbc83-6033-4ff7-acdd-7ff1adf4e79d req-e43290af-e9fb-46d4-b9c1-688ff6911a3d service nova] Creating event network-vif-plugged:de016cfa-e54d-49de-908a-9d8edb413893 for instance aa0309e3-7fd9-4042-abd0-2d4a6e44946e on hv-cinder-81803 Nov 20 03:27:41.955831 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-220fbc83-6033-4ff7-acdd-7ff1adf4e79d req-e43290af-e9fb-46d4-b9c1-688ff6911a3d service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042273 Nov 20 03:27:41.957107 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 276/628] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:27:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:27:42.136945 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ce2c8e26-f088-4660-a2d2-92b3a802e05d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:42.143287 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-83d36266-3c45-498e-a534-d6bce517d17d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:42.144296 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-83d36266-3c45-498e-a534-d6bce517d17d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:42.145346 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ce2c8e26-f088-4660-a2d2-92b3a802e05d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:42.160464 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ce2c8e26-f088-4660-a2d2-92b3a802e05d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:42.162915 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-83d36266-3c45-498e-a534-d6bce517d17d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:42.164153 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ce2c8e26-f088-4660-a2d2-92b3a802e05d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:42.165586 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-83d36266-3c45-498e-a534-d6bce517d17d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:42.166441 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-83d36266-3c45-498e-a534-d6bce517d17d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:42.166886 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-83d36266-3c45-498e-a534-d6bce517d17d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:42.168185 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ce2c8e26-f088-4660-a2d2-92b3a802e05d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:42.169423 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ce2c8e26-f088-4660-a2d2-92b3a802e05d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:42.774952 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-ce2c8e26-f088-4660-a2d2-92b3a802e05d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:42.778660 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-83d36266-3c45-498e-a534-d6bce517d17d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:42.791330 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-83d36266-3c45-498e-a534-d6bce517d17d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:42.791539 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ce2c8e26-f088-4660-a2d2-92b3a802e05d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1314 microversion: 2.1 time: 0.658893 Nov 20 03:27:42.792540 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 353/629] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:42 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1314 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:42.799530 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-83d36266-3c45-498e-a534-d6bce517d17d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:42.802244 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-d0bcf77f-eaa8-4ab7-9101-d9f30c51344c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:42.804176 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-83d36266-3c45-498e-a534-d6bce517d17d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1809 microversion: 2.20 time: 0.665357 Nov 20 03:27:42.804945 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 277/630] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:42 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1809 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:27:42.805813 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-d0bcf77f-eaa8-4ab7-9101-d9f30c51344c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 329637be-05e2-4b96-9709-c1b15f8f5f30] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:42.818937 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-cfe4e36d-0b89-4eba-9b49-1af2778c7122 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:42.819600 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-cfe4e36d-0b89-4eba-9b49-1af2778c7122 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:42.822106 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d0bcf77f-eaa8-4ab7-9101-d9f30c51344c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:42.822564 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d0bcf77f-eaa8-4ab7-9101-d9f30c51344c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:42.823364 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d0bcf77f-eaa8-4ab7-9101-d9f30c51344c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:42.823867 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d0bcf77f-eaa8-4ab7-9101-d9f30c51344c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:42.829047 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cfe4e36d-0b89-4eba-9b49-1af2778c7122 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:42.829694 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cfe4e36d-0b89-4eba-9b49-1af2778c7122 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:42.830970 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cfe4e36d-0b89-4eba-9b49-1af2778c7122 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:42.836733 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cfe4e36d-0b89-4eba-9b49-1af2778c7122 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:42.838878 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.wsgi [None req-d0bcf77f-eaa8-4ab7-9101-d9f30c51344c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] HTTP exception thrown: Instance 329637be-05e2-4b96-9709-c1b15f8f5f30 could not be found. Nov 20 03:27:42.839477 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-d0bcf77f-eaa8-4ab7-9101-d9f30c51344c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Returning 404 to user: Instance 329637be-05e2-4b96-9709-c1b15f8f5f30 could not be found. {{(pid=116113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:27:42.840390 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-d0bcf77f-eaa8-4ab7-9101-d9f30c51344c tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30" status: 404 len: 111 microversion: 2.1 time: 0.046508 Nov 20 03:27:42.841397 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 354/631] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:42 2021] GET /compute/v2.1/servers/329637be-05e2-4b96-9709-c1b15f8f5f30 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:27:42.845877 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-309c870b-20bb-4525-8c96-9472bdd63c89 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:42.846371 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-309c870b-20bb-4525-8c96-9472bdd63c89 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:42.852625 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-309c870b-20bb-4525-8c96-9472bdd63c89 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:42.853083 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-309c870b-20bb-4525-8c96-9472bdd63c89 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:42.853879 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-309c870b-20bb-4525-8c96-9472bdd63c89 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:42.854314 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-309c870b-20bb-4525-8c96-9472bdd63c89 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:42.880383 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-309c870b-20bb-4525-8c96-9472bdd63c89 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Going to try to terminate instance {{(pid=116113) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 03:27:42.968451 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-309c870b-20bb-4525-8c96-9472bdd63c89 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "DELETE /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 204 len: 0 microversion: 2.1 time: 0.125575 Nov 20 03:27:42.969029 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 355/632] 10.222.0.37 () {58 vars in 1238 bytes} [Sat Nov 20 03:27:42 2021] DELETE /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 03:27:42.974343 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-b8dddf54-556d-4abd-9d8c-630b8acddcbb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:42.974924 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-b8dddf54-556d-4abd-9d8c-630b8acddcbb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:42.980895 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b8dddf54-556d-4abd-9d8c-630b8acddcbb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:42.981626 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b8dddf54-556d-4abd-9d8c-630b8acddcbb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:42.982422 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b8dddf54-556d-4abd-9d8c-630b8acddcbb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:42.982864 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b8dddf54-556d-4abd-9d8c-630b8acddcbb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:42.991062 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-cfe4e36d-0b89-4eba-9b49-1af2778c7122 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be02be5f25342d38e5fa007e1c6491e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf913c6c0c784651a7867d309c36b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:43.001384 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-cfe4e36d-0b89-4eba-9b49-1af2778c7122 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 200 len: 1314 microversion: 2.1 time: 0.193363 Nov 20 03:27:43.002183 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 278/633] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:42 2021] GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:43.008400 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-0e26be75-e3c6-46af-9856-ea963c046eb3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:43.009513 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-0e26be75-e3c6-46af-9856-ea963c046eb3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:43.015754 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-b8dddf54-556d-4abd-9d8c-630b8acddcbb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Going to try to terminate instance {{(pid=116113) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 03:27:43.017528 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0e26be75-e3c6-46af-9856-ea963c046eb3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:43.018335 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0e26be75-e3c6-46af-9856-ea963c046eb3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:43.019396 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0e26be75-e3c6-46af-9856-ea963c046eb3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:43.020141 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0e26be75-e3c6-46af-9856-ea963c046eb3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:43.098057 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-b8dddf54-556d-4abd-9d8c-630b8acddcbb tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "DELETE /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 204 len: 0 microversion: 2.1 time: 0.127156 Nov 20 03:27:43.098564 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 356/634] 10.222.0.37 () {58 vars in 1238 bytes} [Sat Nov 20 03:27:42 2021] DELETE /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 03:27:43.107079 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-cd4fde55-22c0-4c4e-b313-117867141a95 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:43.107773 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-cd4fde55-22c0-4c4e-b313-117867141a95 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:43.120500 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cd4fde55-22c0-4c4e-b313-117867141a95 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:43.120959 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cd4fde55-22c0-4c4e-b313-117867141a95 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:43.122363 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cd4fde55-22c0-4c4e-b313-117867141a95 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:43.122802 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cd4fde55-22c0-4c4e-b313-117867141a95 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:43.174863 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-0e26be75-e3c6-46af-9856-ea963c046eb3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:43.182223 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-0e26be75-e3c6-46af-9856-ea963c046eb3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 200 len: 1514 microversion: 2.1 time: 0.178773 Nov 20 03:27:43.182793 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 279/635] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:43 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:43.267865 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-cd4fde55-22c0-4c4e-b313-117867141a95 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:43.275547 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-cd4fde55-22c0-4c4e-b313-117867141a95 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.172821 Nov 20 03:27:43.276134 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 357/636] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:43 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:43.808182 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-90ddcced-cd76-4879-b5d4-16fdffdb16b8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:43.808799 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-90ddcced-cd76-4879-b5d4-16fdffdb16b8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:43.815098 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-90ddcced-cd76-4879-b5d4-16fdffdb16b8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:43.815545 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-90ddcced-cd76-4879-b5d4-16fdffdb16b8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:43.816355 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-90ddcced-cd76-4879-b5d4-16fdffdb16b8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:43.816788 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-90ddcced-cd76-4879-b5d4-16fdffdb16b8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:43.824053 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-6c59e08b-cdad-4819-a7d6-a52cc65504fb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:43.825175 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-6c59e08b-cdad-4819-a7d6-a52cc65504fb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:43.830975 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6c59e08b-cdad-4819-a7d6-a52cc65504fb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:43.831621 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6c59e08b-cdad-4819-a7d6-a52cc65504fb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:43.832609 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6c59e08b-cdad-4819-a7d6-a52cc65504fb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:43.833049 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6c59e08b-cdad-4819-a7d6-a52cc65504fb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:44.013143 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-90ddcced-cd76-4879-b5d4-16fdffdb16b8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:44.020577 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-90ddcced-cd76-4879-b5d4-16fdffdb16b8 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1314 microversion: 2.1 time: 0.215997 Nov 20 03:27:44.020944 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-6c59e08b-cdad-4819-a7d6-a52cc65504fb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:44.021290 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 280/637] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:43 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:44.025783 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-1ce884d1-86da-489c-b3e6-797d56c414ee req-19580f98-26cb-4ffe-8811-511175a638b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bda5a290-2779-45d2-b7a6-fd5996c1f4cc", "name": "network-vif-plugged", "status": "completed", "tag": "cc1c0e14-645b-47e4-8bfb-ee637a3d46e0"}, {"server_uuid": "f68eb618-c745-43db-a873-7c0700c0f11c", "name": "network-vif-plugged", "status": "completed", "tag": "7a19e0fe-867b-45fc-9ef7-f883f1a8dbd9"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:27:44.027454 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:27:44.027454 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:27:44.030492 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-6c59e08b-cdad-4819-a7d6-a52cc65504fb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:44.031995 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-6c59e08b-cdad-4819-a7d6-a52cc65504fb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:44.033130 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-6c59e08b-cdad-4819-a7d6-a52cc65504fb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1809 microversion: 2.20 time: 0.213390 Nov 20 03:27:44.033794 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 358/638] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:43 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1809 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:27:44.035233 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-1ce884d1-86da-489c-b3e6-797d56c414ee req-19580f98-26cb-4ffe-8811-511175a638b6 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:44.035671 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-1ce884d1-86da-489c-b3e6-797d56c414ee req-19580f98-26cb-4ffe-8811-511175a638b6 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:44.038151 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ecc4aa2b-6526-46e1-a73f-22eefd5bae97 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:44.038744 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ecc4aa2b-6526-46e1-a73f-22eefd5bae97 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:44.044738 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ecc4aa2b-6526-46e1-a73f-22eefd5bae97 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:44.045181 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ecc4aa2b-6526-46e1-a73f-22eefd5bae97 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:44.045949 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ecc4aa2b-6526-46e1-a73f-22eefd5bae97 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:44.046401 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ecc4aa2b-6526-46e1-a73f-22eefd5bae97 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:44.048141 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-1ce884d1-86da-489c-b3e6-797d56c414ee req-19580f98-26cb-4ffe-8811-511175a638b6 service nova] Creating event network-vif-plugged:cc1c0e14-645b-47e4-8bfb-ee637a3d46e0 for instance bda5a290-2779-45d2-b7a6-fd5996c1f4cc on hv-cinder-81803 Nov 20 03:27:44.048734 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-1ce884d1-86da-489c-b3e6-797d56c414ee req-19580f98-26cb-4ffe-8811-511175a638b6 service nova] Creating event network-vif-plugged:7a19e0fe-867b-45fc-9ef7-f883f1a8dbd9 for instance f68eb618-c745-43db-a873-7c0700c0f11c on hv-cinder-81803 Nov 20 03:27:44.055394 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-1ce884d1-86da-489c-b3e6-797d56c414ee req-19580f98-26cb-4ffe-8811-511175a638b6 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032689 Nov 20 03:27:44.056254 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 281/639] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:27:44 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:27:44.180724 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-ecc4aa2b-6526-46e1-a73f-22eefd5bae97 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be02be5f25342d38e5fa007e1c6491e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf913c6c0c784651a7867d309c36b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:44.188221 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ecc4aa2b-6526-46e1-a73f-22eefd5bae97 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 200 len: 1314 microversion: 2.1 time: 0.153346 Nov 20 03:27:44.188786 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 359/640] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:44 2021] GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:44.201166 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-24557452-4c60-4626-bd0d-ca00150957fe tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:44.201888 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-24557452-4c60-4626-bd0d-ca00150957fe tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:44.207991 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-24557452-4c60-4626-bd0d-ca00150957fe tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:44.208498 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-24557452-4c60-4626-bd0d-ca00150957fe tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:44.209539 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-24557452-4c60-4626-bd0d-ca00150957fe tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:44.209979 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-24557452-4c60-4626-bd0d-ca00150957fe tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:44.293396 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-55c8313f-36c0-4536-a6e9-d5dd75f39807 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:44.294655 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-55c8313f-36c0-4536-a6e9-d5dd75f39807 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:44.301723 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-55c8313f-36c0-4536-a6e9-d5dd75f39807 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:44.302169 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-55c8313f-36c0-4536-a6e9-d5dd75f39807 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:44.303408 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-55c8313f-36c0-4536-a6e9-d5dd75f39807 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:44.303917 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-55c8313f-36c0-4536-a6e9-d5dd75f39807 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:44.378701 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-24557452-4c60-4626-bd0d-ca00150957fe tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:44.386359 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-24557452-4c60-4626-bd0d-ca00150957fe tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 200 len: 1514 microversion: 2.1 time: 0.190121 Nov 20 03:27:44.386928 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 282/641] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:44 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 1514 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:44.451884 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-55c8313f-36c0-4536-a6e9-d5dd75f39807 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:44.459104 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-55c8313f-36c0-4536-a6e9-d5dd75f39807 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.169795 Nov 20 03:27:44.459666 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 360/642] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:44 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:45.038206 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-cc515622-1c91-4007-9a3c-e7606a8e30c7 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:45.038822 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-cc515622-1c91-4007-9a3c-e7606a8e30c7 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:45.047839 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cc515622-1c91-4007-9a3c-e7606a8e30c7 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:45.048308 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cc515622-1c91-4007-9a3c-e7606a8e30c7 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:45.049161 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cc515622-1c91-4007-9a3c-e7606a8e30c7 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:45.049598 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cc515622-1c91-4007-9a3c-e7606a8e30c7 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:45.051545 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-365423c5-1c9a-4b3d-b232-41a3792a59d4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:45.052199 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-365423c5-1c9a-4b3d-b232-41a3792a59d4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:45.057961 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-365423c5-1c9a-4b3d-b232-41a3792a59d4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:45.058412 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-365423c5-1c9a-4b3d-b232-41a3792a59d4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:45.059257 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-365423c5-1c9a-4b3d-b232-41a3792a59d4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:45.059698 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-365423c5-1c9a-4b3d-b232-41a3792a59d4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:45.234638 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 03:27:45.234893 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: Sat Nov 20 03:27:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc (ip 10.222.0.37) !!! Nov 20 03:27:45.247250 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-cc515622-1c91-4007-9a3c-e7606a8e30c7 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:45.255079 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-365423c5-1c9a-4b3d-b232-41a3792a59d4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:45.257456 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-cc515622-1c91-4007-9a3c-e7606a8e30c7 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1314 microversion: 2.1 time: 0.222914 Nov 20 03:27:45.258030 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 283/643] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:45 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:45.262512 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-5ce01478-005c-4ab1-a597-d7970ecd93f2 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:45.263119 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-5ce01478-005c-4ab1-a597-d7970ecd93f2 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:45.264110 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-365423c5-1c9a-4b3d-b232-41a3792a59d4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:45.265622 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-365423c5-1c9a-4b3d-b232-41a3792a59d4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:45.266779 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-365423c5-1c9a-4b3d-b232-41a3792a59d4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1809 microversion: 2.20 time: 0.218938 Nov 20 03:27:45.267330 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 361/644] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:45 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1809 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:27:45.273879 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5ce01478-005c-4ab1-a597-d7970ecd93f2 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:45.274336 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5ce01478-005c-4ab1-a597-d7970ecd93f2 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:45.275134 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5ce01478-005c-4ab1-a597-d7970ecd93f2 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:45.275572 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5ce01478-005c-4ab1-a597-d7970ecd93f2 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:45.408770 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-5ce01478-005c-4ab1-a597-d7970ecd93f2 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be02be5f25342d38e5fa007e1c6491e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf913c6c0c784651a7867d309c36b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:45.412496 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-6bc675a2-de39-40d9-94a7-a97fb0d729cf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:45.415365 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-6bc675a2-de39-40d9-94a7-a97fb0d729cf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:45.417961 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-5ce01478-005c-4ab1-a597-d7970ecd93f2 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 200 len: 1314 microversion: 2.1 time: 0.158909 Nov 20 03:27:45.418771 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 284/645] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:45 2021] GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:45.426597 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6bc675a2-de39-40d9-94a7-a97fb0d729cf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:45.427050 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6bc675a2-de39-40d9-94a7-a97fb0d729cf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:45.427865 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6bc675a2-de39-40d9-94a7-a97fb0d729cf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:45.428306 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6bc675a2-de39-40d9-94a7-a97fb0d729cf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:45.476689 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-5ef5ff33-d016-4c2c-8883-a1220e480cad tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:45.477498 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-5ef5ff33-d016-4c2c-8883-a1220e480cad tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:45.484201 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5ef5ff33-d016-4c2c-8883-a1220e480cad tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:45.484754 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5ef5ff33-d016-4c2c-8883-a1220e480cad tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:45.485677 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5ef5ff33-d016-4c2c-8883-a1220e480cad tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:45.486182 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5ef5ff33-d016-4c2c-8883-a1220e480cad tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:45.596230 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-6bc675a2-de39-40d9-94a7-a97fb0d729cf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:45.603755 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-6bc675a2-de39-40d9-94a7-a97fb0d729cf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 200 len: 1514 microversion: 2.1 time: 0.203094 Nov 20 03:27:45.604345 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 362/646] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:45 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 1514 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:45.657345 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-5ef5ff33-d016-4c2c-8883-a1220e480cad tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:45.664605 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-5ef5ff33-d016-4c2c-8883-a1220e480cad tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.191907 Nov 20 03:27:45.665167 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 285/647] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:45 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:46.274294 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-bd33a01d-e080-4b20-bb9e-a8e59e63957f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:46.274826 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-bd33a01d-e080-4b20-bb9e-a8e59e63957f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:46.280946 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bd33a01d-e080-4b20-bb9e-a8e59e63957f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:46.281390 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bd33a01d-e080-4b20-bb9e-a8e59e63957f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:46.282162 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bd33a01d-e080-4b20-bb9e-a8e59e63957f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:46.284087 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-ebbd0861-324a-4abe-a7f5-33cb140ba4dc tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:46.284688 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-ebbd0861-324a-4abe-a7f5-33cb140ba4dc tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:46.286429 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bd33a01d-e080-4b20-bb9e-a8e59e63957f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:46.291111 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ebbd0861-324a-4abe-a7f5-33cb140ba4dc tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:46.291721 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ebbd0861-324a-4abe-a7f5-33cb140ba4dc tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:46.292546 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ebbd0861-324a-4abe-a7f5-33cb140ba4dc tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:46.292985 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ebbd0861-324a-4abe-a7f5-33cb140ba4dc tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:46.482074 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-bd33a01d-e080-4b20-bb9e-a8e59e63957f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:46.485486 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-ebbd0861-324a-4abe-a7f5-33cb140ba4dc tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:46.489670 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-bd33a01d-e080-4b20-bb9e-a8e59e63957f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1314 microversion: 2.1 time: 0.219191 Nov 20 03:27:46.490238 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 363/648] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:46 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:46.494040 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-ebbd0861-324a-4abe-a7f5-33cb140ba4dc tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:46.494411 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-7bdb49f2-6b6e-4354-971b-11ce0900a9e9 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:46.495017 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-7bdb49f2-6b6e-4354-971b-11ce0900a9e9 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:46.495756 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-ebbd0861-324a-4abe-a7f5-33cb140ba4dc tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:46.496992 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-ebbd0861-324a-4abe-a7f5-33cb140ba4dc tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1809 microversion: 2.20 time: 0.216796 Nov 20 03:27:46.497714 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 286/649] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:46 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:27:46.505258 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7bdb49f2-6b6e-4354-971b-11ce0900a9e9 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:46.505739 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7bdb49f2-6b6e-4354-971b-11ce0900a9e9 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:46.506523 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7bdb49f2-6b6e-4354-971b-11ce0900a9e9 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:46.506960 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7bdb49f2-6b6e-4354-971b-11ce0900a9e9 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:46.620066 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-bb72f792-9300-4d8a-b85b-6a8bfbcd98cf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:46.620682 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-bb72f792-9300-4d8a-b85b-6a8bfbcd98cf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:46.626526 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bb72f792-9300-4d8a-b85b-6a8bfbcd98cf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:46.626979 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bb72f792-9300-4d8a-b85b-6a8bfbcd98cf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:46.627754 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bb72f792-9300-4d8a-b85b-6a8bfbcd98cf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:46.628243 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bb72f792-9300-4d8a-b85b-6a8bfbcd98cf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:46.640710 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-7bdb49f2-6b6e-4354-971b-11ce0900a9e9 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be02be5f25342d38e5fa007e1c6491e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf913c6c0c784651a7867d309c36b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:46.648128 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-7bdb49f2-6b6e-4354-971b-11ce0900a9e9 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 200 len: 1464 microversion: 2.1 time: 0.156923 Nov 20 03:27:46.654021 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 364/650] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:46 2021] GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 1464 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:46.680875 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-5c35cbfa-5200-4f66-8011-3c6e3ebc5bad tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:46.681488 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-5c35cbfa-5200-4f66-8011-3c6e3ebc5bad tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:46.687510 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5c35cbfa-5200-4f66-8011-3c6e3ebc5bad tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:46.687996 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5c35cbfa-5200-4f66-8011-3c6e3ebc5bad tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:46.688777 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5c35cbfa-5200-4f66-8011-3c6e3ebc5bad tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:46.689216 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5c35cbfa-5200-4f66-8011-3c6e3ebc5bad tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:46.794811 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-bb72f792-9300-4d8a-b85b-6a8bfbcd98cf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:46.802750 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-bb72f792-9300-4d8a-b85b-6a8bfbcd98cf tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 200 len: 1514 microversion: 2.1 time: 0.186231 Nov 20 03:27:46.803663 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 287/651] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:46 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 1514 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:46.807896 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-813e57d5-6695-4bde-b8c5-4df1780e3f5f tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:46.808493 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-813e57d5-6695-4bde-b8c5-4df1780e3f5f tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:46.814860 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-813e57d5-6695-4bde-b8c5-4df1780e3f5f tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:46.815281 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-813e57d5-6695-4bde-b8c5-4df1780e3f5f tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:46.816143 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-813e57d5-6695-4bde-b8c5-4df1780e3f5f tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:46.816647 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-813e57d5-6695-4bde-b8c5-4df1780e3f5f tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:46.842208 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-813e57d5-6695-4bde-b8c5-4df1780e3f5f tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Going to try to terminate instance {{(pid=116114) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 03:27:46.860326 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-5c35cbfa-5200-4f66-8011-3c6e3ebc5bad tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:46.867699 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-5c35cbfa-5200-4f66-8011-3c6e3ebc5bad tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.190391 Nov 20 03:27:46.868342 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 365/652] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:46 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:46.924718 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-813e57d5-6695-4bde-b8c5-4df1780e3f5f tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "DELETE /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 204 len: 0 microversion: 2.1 time: 0.119980 Nov 20 03:27:46.925284 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 288/653] 10.222.0.37 () {58 vars in 1238 bytes} [Sat Nov 20 03:27:46 2021] DELETE /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 03:27:46.933180 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-51cb8045-87a0-43ad-a62f-eaf81de606da tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:46.933865 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-51cb8045-87a0-43ad-a62f-eaf81de606da tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:46.939863 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-51cb8045-87a0-43ad-a62f-eaf81de606da tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:46.940332 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-51cb8045-87a0-43ad-a62f-eaf81de606da tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:46.941186 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-51cb8045-87a0-43ad-a62f-eaf81de606da tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:46.941722 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-51cb8045-87a0-43ad-a62f-eaf81de606da tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:47.076331 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-51cb8045-87a0-43ad-a62f-eaf81de606da tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be02be5f25342d38e5fa007e1c6491e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf913c6c0c784651a7867d309c36b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:47.083533 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-51cb8045-87a0-43ad-a62f-eaf81de606da tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 200 len: 1470 microversion: 2.1 time: 0.154044 Nov 20 03:27:47.084249 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 366/654] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:46 2021] GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:47.506775 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-c0b41037-e612-4a9b-82c9-b1d17d96831d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:47.507465 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-c0b41037-e612-4a9b-82c9-b1d17d96831d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:47.514425 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c0b41037-e612-4a9b-82c9-b1d17d96831d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:47.514865 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c0b41037-e612-4a9b-82c9-b1d17d96831d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:47.515633 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c0b41037-e612-4a9b-82c9-b1d17d96831d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:47.516092 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c0b41037-e612-4a9b-82c9-b1d17d96831d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:47.516974 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-c0422d33-1ff7-4c58-bfcd-3b3b7ba3d862 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:47.517584 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-c0422d33-1ff7-4c58-bfcd-3b3b7ba3d862 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:47.523688 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c0422d33-1ff7-4c58-bfcd-3b3b7ba3d862 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:47.524180 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c0422d33-1ff7-4c58-bfcd-3b3b7ba3d862 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:47.524988 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c0422d33-1ff7-4c58-bfcd-3b3b7ba3d862 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:47.525421 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c0422d33-1ff7-4c58-bfcd-3b3b7ba3d862 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:47.714730 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-c0b41037-e612-4a9b-82c9-b1d17d96831d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:47.718022 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-c0422d33-1ff7-4c58-bfcd-3b3b7ba3d862 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:47.722204 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-c0b41037-e612-4a9b-82c9-b1d17d96831d tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1499 microversion: 2.1 time: 0.219531 Nov 20 03:27:47.723044 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 289/655] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:47 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1499 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:47.726462 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-c0422d33-1ff7-4c58-bfcd-3b3b7ba3d862 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:47.727998 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-c0422d33-1ff7-4c58-bfcd-3b3b7ba3d862 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:47.729148 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-c0422d33-1ff7-4c58-bfcd-3b3b7ba3d862 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1809 microversion: 2.20 time: 0.216076 Nov 20 03:27:47.729682 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 367/656] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:47 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:27:47.819367 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-59e7ef56-e59b-4918-9f87-21d17246c3a4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:47.820107 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-59e7ef56-e59b-4918-9f87-21d17246c3a4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:47.827843 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-59e7ef56-e59b-4918-9f87-21d17246c3a4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:47.828290 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-59e7ef56-e59b-4918-9f87-21d17246c3a4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:47.829508 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-59e7ef56-e59b-4918-9f87-21d17246c3a4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:47.829508 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-59e7ef56-e59b-4918-9f87-21d17246c3a4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:47.884724 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-24575ea8-916c-48ef-ae44-67ec14019686 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:47.885341 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-24575ea8-916c-48ef-ae44-67ec14019686 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:47.891742 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-24575ea8-916c-48ef-ae44-67ec14019686 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:47.892433 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-24575ea8-916c-48ef-ae44-67ec14019686 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:47.893238 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-24575ea8-916c-48ef-ae44-67ec14019686 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:47.894391 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-24575ea8-916c-48ef-ae44-67ec14019686 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:47.996703 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-59e7ef56-e59b-4918-9f87-21d17246c3a4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:48.003945 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-59e7ef56-e59b-4918-9f87-21d17246c3a4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 200 len: 1514 microversion: 2.1 time: 0.188123 Nov 20 03:27:48.004513 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 290/657] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:47 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:48.058867 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-24575ea8-916c-48ef-ae44-67ec14019686 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:48.066131 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-24575ea8-916c-48ef-ae44-67ec14019686 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.185098 Nov 20 03:27:48.066691 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 368/658] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:47 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:48.101887 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-17897cae-4e4c-4241-96d7-038135fb74ea tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:48.102601 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-17897cae-4e4c-4241-96d7-038135fb74ea tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:48.109256 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-17897cae-4e4c-4241-96d7-038135fb74ea tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:48.109824 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-17897cae-4e4c-4241-96d7-038135fb74ea tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:48.110745 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-17897cae-4e4c-4241-96d7-038135fb74ea tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:48.111880 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-17897cae-4e4c-4241-96d7-038135fb74ea tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:48.241981 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-17897cae-4e4c-4241-96d7-038135fb74ea tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be02be5f25342d38e5fa007e1c6491e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf913c6c0c784651a7867d309c36b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:48.249366 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-17897cae-4e4c-4241-96d7-038135fb74ea tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 200 len: 1470 microversion: 2.1 time: 0.151817 Nov 20 03:27:48.249927 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 291/659] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:48 2021] GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:48.596812 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-abefc4e4-41d2-4ae4-98a7-15ab8587da95 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:48.597697 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-abefc4e4-41d2-4ae4-98a7-15ab8587da95 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:48.604069 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-abefc4e4-41d2-4ae4-98a7-15ab8587da95 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:48.604609 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-abefc4e4-41d2-4ae4-98a7-15ab8587da95 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:48.605470 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-abefc4e4-41d2-4ae4-98a7-15ab8587da95 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:48.605978 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-abefc4e4-41d2-4ae4-98a7-15ab8587da95 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:48.642355 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-abefc4e4-41d2-4ae4-98a7-15ab8587da95 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Going to try to terminate instance {{(pid=116113) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 03:27:48.736195 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-abefc4e4-41d2-4ae4-98a7-15ab8587da95 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "DELETE /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 204 len: 0 microversion: 2.1 time: 0.142672 Nov 20 03:27:48.737417 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 369/660] 10.222.0.37 () {58 vars in 1238 bytes} [Sat Nov 20 03:27:48 2021] DELETE /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 03:27:48.745989 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-7d0617d1-3033-41e1-967a-3a711963fe6f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:48.747408 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-7d0617d1-3033-41e1-967a-3a711963fe6f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:48.749900 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-6fc555c9-a970-4df8-863d-3c1e1c81d4a5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:48.750943 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-6fc555c9-a970-4df8-863d-3c1e1c81d4a5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:48.755908 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7d0617d1-3033-41e1-967a-3a711963fe6f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:48.756438 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7d0617d1-3033-41e1-967a-3a711963fe6f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:48.757414 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7d0617d1-3033-41e1-967a-3a711963fe6f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:48.758063 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7d0617d1-3033-41e1-967a-3a711963fe6f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:48.759182 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6fc555c9-a970-4df8-863d-3c1e1c81d4a5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:48.760037 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6fc555c9-a970-4df8-863d-3c1e1c81d4a5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:48.760900 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6fc555c9-a970-4df8-863d-3c1e1c81d4a5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:48.761417 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6fc555c9-a970-4df8-863d-3c1e1c81d4a5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:49.025281 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-7d0617d1-3033-41e1-967a-3a711963fe6f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:49.026564 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-6fc555c9-a970-4df8-863d-3c1e1c81d4a5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:49.035544 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-6fc555c9-a970-4df8-863d-3c1e1c81d4a5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:49.037224 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-6fc555c9-a970-4df8-863d-3c1e1c81d4a5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:49.037356 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-7d0617d1-3033-41e1-967a-3a711963fe6f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1505 microversion: 2.1 time: 0.295315 Nov 20 03:27:49.038606 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 292/661] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:48 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1505 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:49.049699 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-6fc555c9-a970-4df8-863d-3c1e1c81d4a5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1809 microversion: 2.20 time: 0.294870 Nov 20 03:27:49.051878 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 370/662] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:48 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1809 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:27:49.057966 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-37ac629f-f034-4d11-9d7c-8a3f04589aea tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:49.059337 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-37ac629f-f034-4d11-9d7c-8a3f04589aea tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:49.068383 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-f540b582-1369-4503-b124-d36509f1829a req-d408d883-56bf-4775-9b7b-a0aa6ae83ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36116e65-2e67-4d18-84c2-d699cae54285", "name": "network-vif-deleted", "tag": "502d5837-eaef-4602-9057-cc1f1bb18eb2"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:27:49.068810 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-37ac629f-f034-4d11-9d7c-8a3f04589aea tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:49.069528 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-37ac629f-f034-4d11-9d7c-8a3f04589aea tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:49.070494 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-37ac629f-f034-4d11-9d7c-8a3f04589aea tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:49.071089 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-37ac629f-f034-4d11-9d7c-8a3f04589aea tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:49.072387 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:27:49.072387 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:27:49.085955 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-f540b582-1369-4503-b124-d36509f1829a req-d408d883-56bf-4775-9b7b-a0aa6ae83ae8 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:49.086388 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-f540b582-1369-4503-b124-d36509f1829a req-d408d883-56bf-4775-9b7b-a0aa6ae83ae8 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:49.105406 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-f540b582-1369-4503-b124-d36509f1829a req-d408d883-56bf-4775-9b7b-a0aa6ae83ae8 service nova] Creating event network-vif-deleted:502d5837-eaef-4602-9057-cc1f1bb18eb2 for instance 36116e65-2e67-4d18-84c2-d699cae54285 on hv-cinder-81803 Nov 20 03:27:49.110744 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-f540b582-1369-4503-b124-d36509f1829a req-d408d883-56bf-4775-9b7b-a0aa6ae83ae8 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070809 Nov 20 03:27:49.111856 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 293/663] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:27:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:27:49.118993 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-e1f59ccb-79f5-4eca-9d5f-6e03e16d0b14 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:49.120033 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-e1f59ccb-79f5-4eca-9d5f-6e03e16d0b14 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:49.137021 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e1f59ccb-79f5-4eca-9d5f-6e03e16d0b14 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:49.139934 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e1f59ccb-79f5-4eca-9d5f-6e03e16d0b14 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:49.140779 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e1f59ccb-79f5-4eca-9d5f-6e03e16d0b14 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:49.141225 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e1f59ccb-79f5-4eca-9d5f-6e03e16d0b14 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:49.155565 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-37ac629f-f034-4d11-9d7c-8a3f04589aea tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:49.168938 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-37ac629f-f034-4d11-9d7c-8a3f04589aea tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 200 len: 1303 microversion: 2.1 time: 0.115100 Nov 20 03:27:49.170411 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 371/664] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:49 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 1303 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:49.266907 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-844a4862-cdbe-497b-986e-afedc3fe6d3d tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:49.267597 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-844a4862-cdbe-497b-986e-afedc3fe6d3d tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:49.287775 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-844a4862-cdbe-497b-986e-afedc3fe6d3d tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:49.288603 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-844a4862-cdbe-497b-986e-afedc3fe6d3d tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:49.289738 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-844a4862-cdbe-497b-986e-afedc3fe6d3d tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:49.290453 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-844a4862-cdbe-497b-986e-afedc3fe6d3d tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:49.332269 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-e1f59ccb-79f5-4eca-9d5f-6e03e16d0b14 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:49.340112 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-e1f59ccb-79f5-4eca-9d5f-6e03e16d0b14 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.226758 Nov 20 03:27:49.341000 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 294/665] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:49 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:49.444790 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-844a4862-cdbe-497b-986e-afedc3fe6d3d tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be02be5f25342d38e5fa007e1c6491e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf913c6c0c784651a7867d309c36b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:49.452129 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-844a4862-cdbe-497b-986e-afedc3fe6d3d tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 200 len: 1470 microversion: 2.1 time: 0.189484 Nov 20 03:27:49.452676 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 372/666] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:49 2021] GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 1470 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:50.055706 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-2a9618da-2b1d-4296-87ad-6e0029a3b75f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:50.056344 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-2a9618da-2b1d-4296-87ad-6e0029a3b75f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:50.062555 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2a9618da-2b1d-4296-87ad-6e0029a3b75f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:50.063005 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2a9618da-2b1d-4296-87ad-6e0029a3b75f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:50.063805 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2a9618da-2b1d-4296-87ad-6e0029a3b75f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:50.064400 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2a9618da-2b1d-4296-87ad-6e0029a3b75f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:50.071144 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-39a13dd0-bb04-4be5-b0bb-bd924d186743 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:50.071770 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-39a13dd0-bb04-4be5-b0bb-bd924d186743 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:50.094421 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-39a13dd0-bb04-4be5-b0bb-bd924d186743 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:50.094880 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-39a13dd0-bb04-4be5-b0bb-bd924d186743 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:50.095676 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-39a13dd0-bb04-4be5-b0bb-bd924d186743 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:50.096143 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-39a13dd0-bb04-4be5-b0bb-bd924d186743 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:50.267209 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-2a9618da-2b1d-4296-87ad-6e0029a3b75f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:50.274335 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-39a13dd0-bb04-4be5-b0bb-bd924d186743 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:50.274484 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-2a9618da-2b1d-4296-87ad-6e0029a3b75f tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1505 microversion: 2.1 time: 0.222466 Nov 20 03:27:50.274969 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 295/667] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:50 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1505 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:50.279294 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-5953521b-1bcf-4724-a148-91383f99a669 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:50.279913 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-5953521b-1bcf-4724-a148-91383f99a669 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 36116e65-2e67-4d18-84c2-d699cae54285] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:50.286204 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5953521b-1bcf-4724-a148-91383f99a669 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:50.286655 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5953521b-1bcf-4724-a148-91383f99a669 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:50.287450 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5953521b-1bcf-4724-a148-91383f99a669 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:50.287930 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5953521b-1bcf-4724-a148-91383f99a669 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:50.292069 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-39a13dd0-bb04-4be5-b0bb-bd924d186743 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:50.294042 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-39a13dd0-bb04-4be5-b0bb-bd924d186743 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:50.295084 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-39a13dd0-bb04-4be5-b0bb-bd924d186743 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1796 microversion: 2.20 time: 0.229500 Nov 20 03:27:50.295886 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 373/668] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:27:50 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1796 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:27:50.302608 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.wsgi [None req-5953521b-1bcf-4724-a148-91383f99a669 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] HTTP exception thrown: Instance 36116e65-2e67-4d18-84c2-d699cae54285 could not be found. Nov 20 03:27:50.303292 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-5953521b-1bcf-4724-a148-91383f99a669 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Returning 404 to user: Instance 36116e65-2e67-4d18-84c2-d699cae54285 could not be found. {{(pid=116114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:27:50.304237 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-5953521b-1bcf-4724-a148-91383f99a669 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285" status: 404 len: 111 microversion: 2.1 time: 0.028278 Nov 20 03:27:50.304869 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 296/669] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:50 2021] GET /compute/v2.1/servers/36116e65-2e67-4d18-84c2-d699cae54285 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:27:50.363509 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-9866df4c-62cc-4a67-9d65-a148b52d8d71 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:50.364146 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-9866df4c-62cc-4a67-9d65-a148b52d8d71 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:50.370094 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9866df4c-62cc-4a67-9d65-a148b52d8d71 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:50.370540 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9866df4c-62cc-4a67-9d65-a148b52d8d71 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:50.371848 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9866df4c-62cc-4a67-9d65-a148b52d8d71 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:50.372285 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9866df4c-62cc-4a67-9d65-a148b52d8d71 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:50.469578 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-763a8b48-12b4-4ccb-9433-f5516e2014b9 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:50.470209 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-763a8b48-12b4-4ccb-9433-f5516e2014b9 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:50.476216 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-763a8b48-12b4-4ccb-9433-f5516e2014b9 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:50.476673 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-763a8b48-12b4-4ccb-9433-f5516e2014b9 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:50.477439 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-763a8b48-12b4-4ccb-9433-f5516e2014b9 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:50.477868 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-763a8b48-12b4-4ccb-9433-f5516e2014b9 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:50.504712 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9866df4c-62cc-4a67-9d65-a148b52d8d71 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:50.512840 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-9866df4c-62cc-4a67-9d65-a148b52d8d71 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.152658 Nov 20 03:27:50.513405 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 374/670] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:50 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:50.609888 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-763a8b48-12b4-4ccb-9433-f5516e2014b9 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be02be5f25342d38e5fa007e1c6491e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf913c6c0c784651a7867d309c36b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:50.617163 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-763a8b48-12b4-4ccb-9433-f5516e2014b9 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 200 len: 1470 microversion: 2.1 time: 0.151284 Nov 20 03:27:50.617726 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 297/671] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:50 2021] GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:51.291974 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-aa60fdf9-79d8-40b1-a700-3359c1372a64 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:51.292593 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-aa60fdf9-79d8-40b1-a700-3359c1372a64 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:51.299560 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-aa60fdf9-79d8-40b1-a700-3359c1372a64 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:51.300053 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-aa60fdf9-79d8-40b1-a700-3359c1372a64 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:51.300838 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-aa60fdf9-79d8-40b1-a700-3359c1372a64 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:51.301324 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-aa60fdf9-79d8-40b1-a700-3359c1372a64 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:51.430405 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-20b7b32f-86ab-4016-afc4-239d926c83a3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:51.430894 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-20b7b32f-86ab-4016-afc4-239d926c83a3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: dcb49ce9-1111-4384-8066-f155f85972d5] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:51.431554 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-aa60fdf9-79d8-40b1-a700-3359c1372a64 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:51.437395 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-20b7b32f-86ab-4016-afc4-239d926c83a3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:51.437774 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-20b7b32f-86ab-4016-afc4-239d926c83a3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:51.438915 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-20b7b32f-86ab-4016-afc4-239d926c83a3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:51.439503 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-20b7b32f-86ab-4016-afc4-239d926c83a3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:51.439640 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-aa60fdf9-79d8-40b1-a700-3359c1372a64 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1505 microversion: 2.1 time: 0.151261 Nov 20 03:27:51.440336 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 375/672] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:51 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:51.465324 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-20b7b32f-86ab-4016-afc4-239d926c83a3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: dcb49ce9-1111-4384-8066-f155f85972d5] Going to try to terminate instance {{(pid=116114) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 03:27:51.529823 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-05acdbff-185a-42ed-8661-8be9a621ce58 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:51.530688 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-05acdbff-185a-42ed-8661-8be9a621ce58 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:51.537528 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-05acdbff-185a-42ed-8661-8be9a621ce58 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:51.538063 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-05acdbff-185a-42ed-8661-8be9a621ce58 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:51.539616 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-05acdbff-185a-42ed-8661-8be9a621ce58 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:51.540391 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-05acdbff-185a-42ed-8661-8be9a621ce58 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:51.545831 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-20b7b32f-86ab-4016-afc4-239d926c83a3 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "DELETE /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5" status: 204 len: 0 microversion: 2.1 time: 0.119023 Nov 20 03:27:51.546743 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 298/673] 10.222.0.37 () {58 vars in 1238 bytes} [Sat Nov 20 03:27:51 2021] DELETE /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 03:27:51.554751 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-2fb43e8c-8903-4504-839d-c1db9febb5be tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:51.555686 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-2fb43e8c-8903-4504-839d-c1db9febb5be tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: dcb49ce9-1111-4384-8066-f155f85972d5] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:51.562020 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2fb43e8c-8903-4504-839d-c1db9febb5be tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:51.562454 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2fb43e8c-8903-4504-839d-c1db9febb5be tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:51.563415 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2fb43e8c-8903-4504-839d-c1db9febb5be tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:51.564077 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2fb43e8c-8903-4504-839d-c1db9febb5be tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:51.771230 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-05acdbff-185a-42ed-8661-8be9a621ce58 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:51.781402 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-05acdbff-185a-42ed-8661-8be9a621ce58 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.255718 Nov 20 03:27:51.781979 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 376/674] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:51 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:51.786843 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-f4c83137-79e6-4f97-b28c-72714dc75d7f tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:51.787452 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f4c83137-79e6-4f97-b28c-72714dc75d7f tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:51.793625 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f4c83137-79e6-4f97-b28c-72714dc75d7f tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:51.794343 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f4c83137-79e6-4f97-b28c-72714dc75d7f tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:51.794850 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-2fb43e8c-8903-4504-839d-c1db9febb5be tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:51.795744 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f4c83137-79e6-4f97-b28c-72714dc75d7f tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:51.797357 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f4c83137-79e6-4f97-b28c-72714dc75d7f tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:51.806691 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-2fb43e8c-8903-4504-839d-c1db9febb5be tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5" status: 200 len: 1515 microversion: 2.1 time: 0.255890 Nov 20 03:27:51.808448 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 299/675] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:51 2021] GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5 => generated 1515 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:51.813954 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-21e3cffb-2aa4-4881-adad-de6f04413d76 req-19abbd53-0796-4c1a-abd7-1b9a7bec5c0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0309e3-7fd9-4042-abd0-2d4a6e44946e", "name": "network-vif-deleted", "tag": "de016cfa-e54d-49de-908a-9d8edb413893"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:27:51.815831 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:27:51.815831 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:27:51.826714 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-21e3cffb-2aa4-4881-adad-de6f04413d76 req-19abbd53-0796-4c1a-abd7-1b9a7bec5c0e service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:51.837236 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-21e3cffb-2aa4-4881-adad-de6f04413d76 req-19abbd53-0796-4c1a-abd7-1b9a7bec5c0e service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:51.855618 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-21e3cffb-2aa4-4881-adad-de6f04413d76 req-19abbd53-0796-4c1a-abd7-1b9a7bec5c0e service nova] Creating event network-vif-deleted:de016cfa-e54d-49de-908a-9d8edb413893 for instance aa0309e3-7fd9-4042-abd0-2d4a6e44946e on hv-cinder-81803 Nov 20 03:27:51.861562 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-21e3cffb-2aa4-4881-adad-de6f04413d76 req-19abbd53-0796-4c1a-abd7-1b9a7bec5c0e service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051938 Nov 20 03:27:51.862166 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 300/676] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:27:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:27:51.875733 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-f4c83137-79e6-4f97-b28c-72714dc75d7f tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be02be5f25342d38e5fa007e1c6491e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf913c6c0c784651a7867d309c36b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:51.885103 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-f4c83137-79e6-4f97-b28c-72714dc75d7f tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 200 len: 1428 microversion: 2.1 time: 0.101674 Nov 20 03:27:51.885686 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 377/677] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:51 2021] GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 1428 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:52.457472 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-ac98ae88-5b20-4ea0-811b-1200b8483df2 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:52.458160 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-ac98ae88-5b20-4ea0-811b-1200b8483df2 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:52.464352 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ac98ae88-5b20-4ea0-811b-1200b8483df2 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:52.464809 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ac98ae88-5b20-4ea0-811b-1200b8483df2 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:52.466101 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ac98ae88-5b20-4ea0-811b-1200b8483df2 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:52.466535 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ac98ae88-5b20-4ea0-811b-1200b8483df2 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:52.602816 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-ac98ae88-5b20-4ea0-811b-1200b8483df2 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459d890323c24949b698061a926af1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3619424d1b174797a1d4f1370072ff9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:52.614905 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-ac98ae88-5b20-4ea0-811b-1200b8483df2 tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 200 len: 1505 microversion: 2.1 time: 0.161464 Nov 20 03:27:52.624801 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 301/678] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:52 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:52.799398 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-be6fd5c3-b502-43de-b7ca-fe2c4593a715 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:52.800236 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-be6fd5c3-b502-43de-b7ca-fe2c4593a715 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:52.806669 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-be6fd5c3-b502-43de-b7ca-fe2c4593a715 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:52.807124 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-be6fd5c3-b502-43de-b7ca-fe2c4593a715 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:52.807953 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-be6fd5c3-b502-43de-b7ca-fe2c4593a715 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:52.808380 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-be6fd5c3-b502-43de-b7ca-fe2c4593a715 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:52.827119 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-37714e37-de4f-43be-91c1-df306706c839 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:52.828222 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-37714e37-de4f-43be-91c1-df306706c839 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: dcb49ce9-1111-4384-8066-f155f85972d5] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:52.834961 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-37714e37-de4f-43be-91c1-df306706c839 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:52.835412 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-37714e37-de4f-43be-91c1-df306706c839 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:52.836311 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-37714e37-de4f-43be-91c1-df306706c839 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:52.836963 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-37714e37-de4f-43be-91c1-df306706c839 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:53.001255 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-be6fd5c3-b502-43de-b7ca-fe2c4593a715 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:53.008635 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-be6fd5c3-b502-43de-b7ca-fe2c4593a715 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.213328 Nov 20 03:27:53.009283 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 378/679] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:52 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:53.014063 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-71c03b3b-c5a2-4c56-9538-73bd8c52b0f4 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:53.014885 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-71c03b3b-c5a2-4c56-9538-73bd8c52b0f4 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] [instance: aa0309e3-7fd9-4042-abd0-2d4a6e44946e] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:53.020885 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-71c03b3b-c5a2-4c56-9538-73bd8c52b0f4 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:53.021332 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-71c03b3b-c5a2-4c56-9538-73bd8c52b0f4 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:53.022115 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-71c03b3b-c5a2-4c56-9538-73bd8c52b0f4 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:53.022453 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-37714e37-de4f-43be-91c1-df306706c839 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:53.022578 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-71c03b3b-c5a2-4c56-9538-73bd8c52b0f4 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:53.030594 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-37714e37-de4f-43be-91c1-df306706c839 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5" status: 200 len: 1515 microversion: 2.1 time: 0.209396 Nov 20 03:27:53.031166 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 302/680] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:52 2021] GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5 => generated 1515 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:53.036489 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.wsgi [None req-71c03b3b-c5a2-4c56-9538-73bd8c52b0f4 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] HTTP exception thrown: Instance aa0309e3-7fd9-4042-abd0-2d4a6e44946e could not be found. Nov 20 03:27:53.037101 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-71c03b3b-c5a2-4c56-9538-73bd8c52b0f4 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] Returning 404 to user: Instance aa0309e3-7fd9-4042-abd0-2d4a6e44946e could not be found. {{(pid=116113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:27:53.038044 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-71c03b3b-c5a2-4c56-9538-73bd8c52b0f4 tempest-VolumesNegativeTest-184278237 tempest-VolumesNegativeTest-184278237-project] 10.222.0.37 "GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e" status: 404 len: 111 microversion: 2.1 time: 0.027777 Nov 20 03:27:53.038590 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 379/681] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:53 2021] GET /compute/v2.1/servers/aa0309e3-7fd9-4042-abd0-2d4a6e44946e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:27:53.632001 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-1a016260-b5ff-435d-86f9-17f5f26ae8af tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:53.632626 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-1a016260-b5ff-435d-86f9-17f5f26ae8af tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] [instance: bda5a290-2779-45d2-b7a6-fd5996c1f4cc] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:53.639020 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1a016260-b5ff-435d-86f9-17f5f26ae8af tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:53.639466 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1a016260-b5ff-435d-86f9-17f5f26ae8af tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:53.640277 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1a016260-b5ff-435d-86f9-17f5f26ae8af tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:53.640712 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1a016260-b5ff-435d-86f9-17f5f26ae8af tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:53.653966 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.wsgi [None req-1a016260-b5ff-435d-86f9-17f5f26ae8af tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] HTTP exception thrown: Instance bda5a290-2779-45d2-b7a6-fd5996c1f4cc could not be found. Nov 20 03:27:53.654553 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-1a016260-b5ff-435d-86f9-17f5f26ae8af tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] Returning 404 to user: Instance bda5a290-2779-45d2-b7a6-fd5996c1f4cc could not be found. {{(pid=116114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:27:53.655498 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-1a016260-b5ff-435d-86f9-17f5f26ae8af tempest-VolumesActionsTest-1117270122 tempest-VolumesActionsTest-1117270122-project] 10.222.0.37 "GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc" status: 404 len: 111 microversion: 2.1 time: 0.027253 Nov 20 03:27:53.656145 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 303/682] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:53 2021] GET /compute/v2.1/servers/bda5a290-2779-45d2-b7a6-fd5996c1f4cc => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:27:53.879641 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-0b55e177-adc8-40f5-94b2-8d9acfdabf53 req-806d6fe1-b49c-4222-a56c-41d58e86c79e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bda5a290-2779-45d2-b7a6-fd5996c1f4cc", "name": "network-vif-deleted", "tag": "cc1c0e14-645b-47e4-8bfb-ee637a3d46e0"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:27:53.881259 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:27:53.881259 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:27:53.889077 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-0b55e177-adc8-40f5-94b2-8d9acfdabf53 req-806d6fe1-b49c-4222-a56c-41d58e86c79e service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:53.889449 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-0b55e177-adc8-40f5-94b2-8d9acfdabf53 req-806d6fe1-b49c-4222-a56c-41d58e86c79e service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:53.909384 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-0b55e177-adc8-40f5-94b2-8d9acfdabf53 req-806d6fe1-b49c-4222-a56c-41d58e86c79e service nova] Creating event network-vif-deleted:cc1c0e14-645b-47e4-8bfb-ee637a3d46e0 for instance bda5a290-2779-45d2-b7a6-fd5996c1f4cc on hv-cinder-81803 Nov 20 03:27:53.914394 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-0b55e177-adc8-40f5-94b2-8d9acfdabf53 req-806d6fe1-b49c-4222-a56c-41d58e86c79e service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038411 Nov 20 03:27:53.914979 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 380/683] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:27:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:27:54.026659 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-9853dcb6-0462-4b12-8dd7-5865850fe72a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:54.027274 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-9853dcb6-0462-4b12-8dd7-5865850fe72a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:54.033512 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9853dcb6-0462-4b12-8dd7-5865850fe72a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:54.033964 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9853dcb6-0462-4b12-8dd7-5865850fe72a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:54.034746 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9853dcb6-0462-4b12-8dd7-5865850fe72a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:54.035216 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9853dcb6-0462-4b12-8dd7-5865850fe72a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:54.049608 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-d2c14b0c-90b9-4938-a0e8-f3a78c98211d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:54.051288 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-d2c14b0c-90b9-4938-a0e8-f3a78c98211d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: dcb49ce9-1111-4384-8066-f155f85972d5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:54.062383 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d2c14b0c-90b9-4938-a0e8-f3a78c98211d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:54.062986 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d2c14b0c-90b9-4938-a0e8-f3a78c98211d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:54.063853 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d2c14b0c-90b9-4938-a0e8-f3a78c98211d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:54.064300 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d2c14b0c-90b9-4938-a0e8-f3a78c98211d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:54.253415 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-9853dcb6-0462-4b12-8dd7-5865850fe72a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:54.263005 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-9853dcb6-0462-4b12-8dd7-5865850fe72a tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.239720 Nov 20 03:27:54.263861 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 304/684] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:54 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:54.289118 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-d2c14b0c-90b9-4938-a0e8-f3a78c98211d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:54.304764 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-d2c14b0c-90b9-4938-a0e8-f3a78c98211d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5" status: 200 len: 1515 microversion: 2.1 time: 0.260473 Nov 20 03:27:54.305019 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 381/685] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:54 2021] GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5 => generated 1515 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:55.280347 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-dab4d051-d765-4bbf-b9c4-be5fd2cecce2 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:55.281001 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-dab4d051-d765-4bbf-b9c4-be5fd2cecce2 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:55.288024 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dab4d051-d765-4bbf-b9c4-be5fd2cecce2 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:55.288487 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dab4d051-d765-4bbf-b9c4-be5fd2cecce2 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:55.289274 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dab4d051-d765-4bbf-b9c4-be5fd2cecce2 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:55.289715 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dab4d051-d765-4bbf-b9c4-be5fd2cecce2 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:55.321568 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-4c19177f-3f67-4ddf-9c80-8a327aa4569f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:55.322290 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-4c19177f-3f67-4ddf-9c80-8a327aa4569f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: dcb49ce9-1111-4384-8066-f155f85972d5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:55.330466 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4c19177f-3f67-4ddf-9c80-8a327aa4569f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:55.331532 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4c19177f-3f67-4ddf-9c80-8a327aa4569f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:55.332572 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4c19177f-3f67-4ddf-9c80-8a327aa4569f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:55.333116 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4c19177f-3f67-4ddf-9c80-8a327aa4569f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:55.473404 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-dab4d051-d765-4bbf-b9c4-be5fd2cecce2 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:55.480747 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-dab4d051-d765-4bbf-b9c4-be5fd2cecce2 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.204615 Nov 20 03:27:55.481364 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 305/686] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:55 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:55.523978 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-4c19177f-3f67-4ddf-9c80-8a327aa4569f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:55.531895 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-4c19177f-3f67-4ddf-9c80-8a327aa4569f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5" status: 200 len: 1515 microversion: 2.1 time: 0.214106 Nov 20 03:27:55.532563 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 382/687] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:55 2021] GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5 => generated 1515 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:56.498896 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-9543b5cb-7643-45b9-b2d6-0035ba390c30 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:56.499441 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-9543b5cb-7643-45b9-b2d6-0035ba390c30 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:56.505779 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9543b5cb-7643-45b9-b2d6-0035ba390c30 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:56.506233 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9543b5cb-7643-45b9-b2d6-0035ba390c30 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:56.507020 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9543b5cb-7643-45b9-b2d6-0035ba390c30 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:56.507461 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9543b5cb-7643-45b9-b2d6-0035ba390c30 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:56.548384 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-a20720fe-5d91-4b73-bb1f-0de5545008d7 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:56.549000 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-a20720fe-5d91-4b73-bb1f-0de5545008d7 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: dcb49ce9-1111-4384-8066-f155f85972d5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:56.555200 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a20720fe-5d91-4b73-bb1f-0de5545008d7 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:56.555803 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a20720fe-5d91-4b73-bb1f-0de5545008d7 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:56.556480 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a20720fe-5d91-4b73-bb1f-0de5545008d7 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:56.556915 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a20720fe-5d91-4b73-bb1f-0de5545008d7 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:56.680957 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-9543b5cb-7643-45b9-b2d6-0035ba390c30 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:56.689010 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-9543b5cb-7643-45b9-b2d6-0035ba390c30 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.194992 Nov 20 03:27:56.689571 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 306/688] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:56 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:56.724246 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a20720fe-5d91-4b73-bb1f-0de5545008d7 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:56.732023 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-a20720fe-5d91-4b73-bb1f-0de5545008d7 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5" status: 200 len: 1515 microversion: 2.1 time: 0.187197 Nov 20 03:27:56.732948 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 383/689] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:56 2021] GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5 => generated 1515 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:57.705749 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-60c135b6-342c-4b4e-af88-a65a936d2704 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:57.706364 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-60c135b6-342c-4b4e-af88-a65a936d2704 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:57.712645 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-60c135b6-342c-4b4e-af88-a65a936d2704 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:57.713129 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-60c135b6-342c-4b4e-af88-a65a936d2704 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:57.713906 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-60c135b6-342c-4b4e-af88-a65a936d2704 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:57.714342 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-60c135b6-342c-4b4e-af88-a65a936d2704 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:57.750469 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-d6eb73c3-a9bb-4c40-9d28-d535295b81a2 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:57.751340 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-d6eb73c3-a9bb-4c40-9d28-d535295b81a2 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: dcb49ce9-1111-4384-8066-f155f85972d5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:57.758287 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d6eb73c3-a9bb-4c40-9d28-d535295b81a2 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:57.758731 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d6eb73c3-a9bb-4c40-9d28-d535295b81a2 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:57.759900 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d6eb73c3-a9bb-4c40-9d28-d535295b81a2 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:57.760345 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d6eb73c3-a9bb-4c40-9d28-d535295b81a2 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:57.890200 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-60c135b6-342c-4b4e-af88-a65a936d2704 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:57.898252 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-60c135b6-342c-4b4e-af88-a65a936d2704 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.195768 Nov 20 03:27:57.904798 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 307/690] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:57 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:27:57.935345 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-d6eb73c3-a9bb-4c40-9d28-d535295b81a2 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:57.943103 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-d6eb73c3-a9bb-4c40-9d28-d535295b81a2 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5" status: 200 len: 1515 microversion: 2.1 time: 0.197631 Nov 20 03:27:57.943595 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 384/691] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:57 2021] GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5 => generated 1515 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:58.396580 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-9dac29a3-6945-48f5-9213-9539d78613a0 req-0a564fdb-739c-4c47-89cc-a2b5836b27ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb49ce9-1111-4384-8066-f155f85972d5", "name": "network-vif-deleted", "tag": "20da1bff-d668-4898-a7cd-882e011aca51"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:27:58.398550 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:27:58.398550 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:27:58.407190 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-9dac29a3-6945-48f5-9213-9539d78613a0 req-0a564fdb-739c-4c47-89cc-a2b5836b27ab service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:58.407641 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-9dac29a3-6945-48f5-9213-9539d78613a0 req-0a564fdb-739c-4c47-89cc-a2b5836b27ab service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:58.420209 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-9dac29a3-6945-48f5-9213-9539d78613a0 req-0a564fdb-739c-4c47-89cc-a2b5836b27ab service nova] Creating event network-vif-deleted:20da1bff-d668-4898-a7cd-882e011aca51 for instance dcb49ce9-1111-4384-8066-f155f85972d5 on hv-cinder-81803 Nov 20 03:27:58.425324 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-9dac29a3-6945-48f5-9213-9539d78613a0 req-0a564fdb-739c-4c47-89cc-a2b5836b27ab service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032440 Nov 20 03:27:58.425923 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 308/692] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:27:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:27:58.914836 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-154b89ae-4168-40bb-b8a3-6d84d7f43ad9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:58.915573 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-154b89ae-4168-40bb-b8a3-6d84d7f43ad9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:58.922600 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-154b89ae-4168-40bb-b8a3-6d84d7f43ad9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:58.923055 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-154b89ae-4168-40bb-b8a3-6d84d7f43ad9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:58.923918 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-154b89ae-4168-40bb-b8a3-6d84d7f43ad9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:58.924337 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-154b89ae-4168-40bb-b8a3-6d84d7f43ad9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:58.961574 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-0b102d2e-45f2-4d48-a6cb-1ce0c93fb5f4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:27:58.962447 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-0b102d2e-45f2-4d48-a6cb-1ce0c93fb5f4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: dcb49ce9-1111-4384-8066-f155f85972d5] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:27:58.970109 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0b102d2e-45f2-4d48-a6cb-1ce0c93fb5f4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:58.970641 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0b102d2e-45f2-4d48-a6cb-1ce0c93fb5f4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:58.971553 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0b102d2e-45f2-4d48-a6cb-1ce0c93fb5f4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:58.972082 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0b102d2e-45f2-4d48-a6cb-1ce0c93fb5f4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:59.004857 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0b102d2e-45f2-4d48-a6cb-1ce0c93fb5f4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:27:59.004857 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0b102d2e-45f2-4d48-a6cb-1ce0c93fb5f4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:27:59.005309 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.objects.instance [None req-0b102d2e-45f2-4d48-a6cb-1ce0c93fb5f4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lazy-loading 'fault' on Instance uuid dcb49ce9-1111-4384-8066-f155f85972d5 {{(pid=116114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 03:27:59.057241 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-0b102d2e-45f2-4d48-a6cb-1ce0c93fb5f4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:59.065433 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-0b102d2e-45f2-4d48-a6cb-1ce0c93fb5f4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5" status: 200 len: 1308 microversion: 2.1 time: 0.107915 Nov 20 03:27:59.065979 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 309/693] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:58 2021] GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5 => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:27:59.078880 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-154b89ae-4168-40bb-b8a3-6d84d7f43ad9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:27:59.086069 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-154b89ae-4168-40bb-b8a3-6d84d7f43ad9 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1523 microversion: 2.1 time: 0.175548 Nov 20 03:27:59.086623 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 385/694] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:27:58 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:28:00.082240 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-1ec76a2e-1393-4323-97f2-7d36c90292d0 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:00.082789 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-1ec76a2e-1393-4323-97f2-7d36c90292d0 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: dcb49ce9-1111-4384-8066-f155f85972d5] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:00.104661 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-75ff56db-1d9d-46d2-959c-d5cbc65901a8 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:00.106183 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1ec76a2e-1393-4323-97f2-7d36c90292d0 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:00.106332 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-75ff56db-1d9d-46d2-959c-d5cbc65901a8 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:00.106929 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1ec76a2e-1393-4323-97f2-7d36c90292d0 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:00.107768 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1ec76a2e-1393-4323-97f2-7d36c90292d0 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:00.108690 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1ec76a2e-1393-4323-97f2-7d36c90292d0 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:00.124848 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.wsgi [None req-1ec76a2e-1393-4323-97f2-7d36c90292d0 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] HTTP exception thrown: Instance dcb49ce9-1111-4384-8066-f155f85972d5 could not be found. Nov 20 03:28:00.125670 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-1ec76a2e-1393-4323-97f2-7d36c90292d0 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Returning 404 to user: Instance dcb49ce9-1111-4384-8066-f155f85972d5 could not be found. {{(pid=116114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:28:00.126698 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-1ec76a2e-1393-4323-97f2-7d36c90292d0 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5" status: 404 len: 111 microversion: 2.1 time: 0.048240 Nov 20 03:28:00.128202 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 310/695] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:28:00 2021] GET /compute/v2.1/servers/dcb49ce9-1111-4384-8066-f155f85972d5 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:28:00.135933 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-34f26a31-b25f-46ed-9860-0a9f0769cbb9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:00.136653 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-34f26a31-b25f-46ed-9860-0a9f0769cbb9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: f99425ad-063b-41de-ada4-431531d73cf9] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:00.137721 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-75ff56db-1d9d-46d2-959c-d5cbc65901a8 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:00.144377 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-75ff56db-1d9d-46d2-959c-d5cbc65901a8 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:00.145048 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-34f26a31-b25f-46ed-9860-0a9f0769cbb9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:00.145422 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-75ff56db-1d9d-46d2-959c-d5cbc65901a8 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:00.146255 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-34f26a31-b25f-46ed-9860-0a9f0769cbb9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:00.146804 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-75ff56db-1d9d-46d2-959c-d5cbc65901a8 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:00.147399 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-34f26a31-b25f-46ed-9860-0a9f0769cbb9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:00.148308 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-34f26a31-b25f-46ed-9860-0a9f0769cbb9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:00.182188 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-34f26a31-b25f-46ed-9860-0a9f0769cbb9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: f99425ad-063b-41de-ada4-431531d73cf9] Going to try to terminate instance {{(pid=116114) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 03:28:00.307904 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-34f26a31-b25f-46ed-9860-0a9f0769cbb9 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "DELETE /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9" status: 204 len: 0 microversion: 2.1 time: 0.174719 Nov 20 03:28:00.308856 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 311/696] 10.222.0.37 () {58 vars in 1238 bytes} [Sat Nov 20 03:28:00 2021] DELETE /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 20 03:28:00.320700 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-75ff56db-1d9d-46d2-959c-d5cbc65901a8 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71169193963848168fee643c10ecdf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b3ce6068f54d3f97b14f94f674223b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:00.329775 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-75ff56db-1d9d-46d2-959c-d5cbc65901a8 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 200 len: 1481 microversion: 2.1 time: 0.229100 Nov 20 03:28:00.330355 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 386/697] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:28:00 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 1481 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:28:00.342285 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-36b47115-5642-4c1e-be8f-a623b580d96f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:00.343005 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-36b47115-5642-4c1e-be8f-a623b580d96f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: f99425ad-063b-41de-ada4-431531d73cf9] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:00.351000 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-36b47115-5642-4c1e-be8f-a623b580d96f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:00.351456 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-36b47115-5642-4c1e-be8f-a623b580d96f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:00.352317 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-36b47115-5642-4c1e-be8f-a623b580d96f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:00.352985 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-36b47115-5642-4c1e-be8f-a623b580d96f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:00.519951 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-01bbf7f3-7ec2-445f-af21-61a68278497d req-22fdcc44-bf99-480b-a065-5a60bd04f5ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1520eab8-d6b9-48aa-8333-5c7758310e82", "name": "network-vif-deleted", "tag": "04b72906-e641-41e4-a5a9-636c7cd117c9"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:28:00.521677 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:28:00.521677 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:28:00.535560 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-01bbf7f3-7ec2-445f-af21-61a68278497d req-22fdcc44-bf99-480b-a065-5a60bd04f5ac service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:00.536207 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-01bbf7f3-7ec2-445f-af21-61a68278497d req-22fdcc44-bf99-480b-a065-5a60bd04f5ac service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:00.565168 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-01bbf7f3-7ec2-445f-af21-61a68278497d req-22fdcc44-bf99-480b-a065-5a60bd04f5ac service nova] Creating event network-vif-deleted:04b72906-e641-41e4-a5a9-636c7cd117c9 for instance 1520eab8-d6b9-48aa-8333-5c7758310e82 on hv-cinder-81803 Nov 20 03:28:00.572196 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-01bbf7f3-7ec2-445f-af21-61a68278497d req-22fdcc44-bf99-480b-a065-5a60bd04f5ac service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055840 Nov 20 03:28:00.575900 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 387/698] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:28:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:28:00.604104 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-36b47115-5642-4c1e-be8f-a623b580d96f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:00.613775 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-36b47115-5642-4c1e-be8f-a623b580d96f tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9" status: 200 len: 1514 microversion: 2.1 time: 0.299753 Nov 20 03:28:00.614346 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 312/699] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:28:00 2021] GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9 => generated 1514 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:28:01.348133 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-57c9784e-3b23-415a-96e0-5dfeeecc9797 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:01.349059 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-57c9784e-3b23-415a-96e0-5dfeeecc9797 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] [instance: 1520eab8-d6b9-48aa-8333-5c7758310e82] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:01.355475 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-57c9784e-3b23-415a-96e0-5dfeeecc9797 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:01.356470 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-57c9784e-3b23-415a-96e0-5dfeeecc9797 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:01.357371 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-57c9784e-3b23-415a-96e0-5dfeeecc9797 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:01.357996 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-57c9784e-3b23-415a-96e0-5dfeeecc9797 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:01.371190 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.wsgi [None req-57c9784e-3b23-415a-96e0-5dfeeecc9797 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] HTTP exception thrown: Instance 1520eab8-d6b9-48aa-8333-5c7758310e82 could not be found. Nov 20 03:28:01.372602 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-57c9784e-3b23-415a-96e0-5dfeeecc9797 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] Returning 404 to user: Instance 1520eab8-d6b9-48aa-8333-5c7758310e82 could not be found. {{(pid=116113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:28:01.373677 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-57c9784e-3b23-415a-96e0-5dfeeecc9797 tempest-ServerRescueNegativeTestJSON-1055362359 tempest-ServerRescueNegativeTestJSON-1055362359-project] 10.222.0.37 "GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82" status: 404 len: 111 microversion: 2.1 time: 0.030488 Nov 20 03:28:01.374213 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 388/700] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:28:01 2021] GET /compute/v2.1/servers/1520eab8-d6b9-48aa-8333-5c7758310e82 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:28:01.641015 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-5fe5d3f8-0859-40c1-817f-82c0507c65f7 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:01.641641 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-5fe5d3f8-0859-40c1-817f-82c0507c65f7 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: f99425ad-063b-41de-ada4-431531d73cf9] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:01.655100 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5fe5d3f8-0859-40c1-817f-82c0507c65f7 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:01.657453 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5fe5d3f8-0859-40c1-817f-82c0507c65f7 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:01.660321 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5fe5d3f8-0859-40c1-817f-82c0507c65f7 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:01.664860 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5fe5d3f8-0859-40c1-817f-82c0507c65f7 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:01.998073 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-5fe5d3f8-0859-40c1-817f-82c0507c65f7 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:02.007637 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-5fe5d3f8-0859-40c1-817f-82c0507c65f7 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9" status: 200 len: 1514 microversion: 2.1 time: 0.379413 Nov 20 03:28:02.020495 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 313/701] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:28:01 2021] GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9 => generated 1514 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:28:03.026480 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-8be45901-11c1-4222-acd0-eda65945b96d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:03.028011 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-8be45901-11c1-4222-acd0-eda65945b96d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: f99425ad-063b-41de-ada4-431531d73cf9] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:03.037788 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8be45901-11c1-4222-acd0-eda65945b96d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:03.039359 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8be45901-11c1-4222-acd0-eda65945b96d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:03.040463 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8be45901-11c1-4222-acd0-eda65945b96d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:03.041116 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8be45901-11c1-4222-acd0-eda65945b96d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:03.426000 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-8be45901-11c1-4222-acd0-eda65945b96d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:03.435394 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-8be45901-11c1-4222-acd0-eda65945b96d tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9" status: 200 len: 1514 microversion: 2.1 time: 0.413495 Nov 20 03:28:03.436248 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 389/702] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:28:03 2021] GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9 => generated 1514 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:28:03.558925 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-b4a4846d-44cc-4db1-9a4e-1e2ea00719a7 req-f91214f9-917f-477d-935d-1e069680a2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f99425ad-063b-41de-ada4-431531d73cf9", "name": "network-vif-deleted", "tag": "409ff6fa-0f7f-4eb4-b321-ee164178b6cd"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:28:03.561328 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:28:03.561328 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:28:03.572819 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-b4a4846d-44cc-4db1-9a4e-1e2ea00719a7 req-f91214f9-917f-477d-935d-1e069680a2a1 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:03.576300 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-b4a4846d-44cc-4db1-9a4e-1e2ea00719a7 req-f91214f9-917f-477d-935d-1e069680a2a1 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:03.599856 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-b4a4846d-44cc-4db1-9a4e-1e2ea00719a7 req-f91214f9-917f-477d-935d-1e069680a2a1 service nova] Creating event network-vif-deleted:409ff6fa-0f7f-4eb4-b321-ee164178b6cd for instance f99425ad-063b-41de-ada4-431531d73cf9 on hv-cinder-81803 Nov 20 03:28:03.605176 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-b4a4846d-44cc-4db1-9a4e-1e2ea00719a7 req-f91214f9-917f-477d-935d-1e069680a2a1 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049995 Nov 20 03:28:03.606921 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 314/703] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:28:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:28:04.457667 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-59f4458b-3295-48bb-9e7d-bd10724e14cc tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:04.458953 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-59f4458b-3295-48bb-9e7d-bd10724e14cc tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: f99425ad-063b-41de-ada4-431531d73cf9] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:04.483402 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-59f4458b-3295-48bb-9e7d-bd10724e14cc tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:04.487348 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-59f4458b-3295-48bb-9e7d-bd10724e14cc tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:04.488399 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-59f4458b-3295-48bb-9e7d-bd10724e14cc tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:04.489004 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-59f4458b-3295-48bb-9e7d-bd10724e14cc tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:04.530341 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.wsgi [None req-59f4458b-3295-48bb-9e7d-bd10724e14cc tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] HTTP exception thrown: Instance f99425ad-063b-41de-ada4-431531d73cf9 could not be found. Nov 20 03:28:04.531184 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-59f4458b-3295-48bb-9e7d-bd10724e14cc tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Returning 404 to user: Instance f99425ad-063b-41de-ada4-431531d73cf9 could not be found. {{(pid=116113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:28:04.532324 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-59f4458b-3295-48bb-9e7d-bd10724e14cc tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9" status: 404 len: 111 microversion: 2.1 time: 0.080950 Nov 20 03:28:04.533770 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 390/704] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:28:04 2021] GET /compute/v2.1/servers/f99425ad-063b-41de-ada4-431531d73cf9 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:28:05.749903 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-528b37f5-6bb9-404a-b074-6bce419ef24b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:05.751421 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-528b37f5-6bb9-404a-b074-6bce419ef24b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:05.764627 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-528b37f5-6bb9-404a-b074-6bce419ef24b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:05.765384 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-528b37f5-6bb9-404a-b074-6bce419ef24b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:05.766388 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-528b37f5-6bb9-404a-b074-6bce419ef24b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:05.769508 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-528b37f5-6bb9-404a-b074-6bce419ef24b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:05.800455 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-528b37f5-6bb9-404a-b074-6bce419ef24b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Going to try to terminate instance {{(pid=116114) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 03:28:05.928925 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-528b37f5-6bb9-404a-b074-6bce419ef24b tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "DELETE /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 204 len: 0 microversion: 2.1 time: 0.181020 Nov 20 03:28:05.929921 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 315/705] 10.222.0.37 () {58 vars in 1238 bytes} [Sat Nov 20 03:28:05 2021] DELETE /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 03:28:05.956877 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-301ac11a-9090-4bc9-a8e8-7c01e555bead tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:05.957560 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-301ac11a-9090-4bc9-a8e8-7c01e555bead tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:06.021276 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-301ac11a-9090-4bc9-a8e8-7c01e555bead tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:06.022617 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-301ac11a-9090-4bc9-a8e8-7c01e555bead tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:06.024905 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-301ac11a-9090-4bc9-a8e8-7c01e555bead tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:06.027219 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-301ac11a-9090-4bc9-a8e8-7c01e555bead tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:06.218987 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-301ac11a-9090-4bc9-a8e8-7c01e555bead tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:06.229477 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-301ac11a-9090-4bc9-a8e8-7c01e555bead tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 200 len: 1513 microversion: 2.1 time: 0.290990 Nov 20 03:28:06.230050 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 391/706] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:28:05 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 1513 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:28:07.247608 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-ffb27df5-b8ff-40a4-8029-24e85bb1659e tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:07.248416 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-ffb27df5-b8ff-40a4-8029-24e85bb1659e tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:07.254959 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ffb27df5-b8ff-40a4-8029-24e85bb1659e tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:07.255418 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ffb27df5-b8ff-40a4-8029-24e85bb1659e tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:07.256289 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ffb27df5-b8ff-40a4-8029-24e85bb1659e tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:07.256732 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ffb27df5-b8ff-40a4-8029-24e85bb1659e tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:07.441526 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-ffb27df5-b8ff-40a4-8029-24e85bb1659e tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:07.456393 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-ffb27df5-b8ff-40a4-8029-24e85bb1659e tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 200 len: 1513 microversion: 2.1 time: 0.213527 Nov 20 03:28:07.457110 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 316/707] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:28:07 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 1513 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:28:08.476047 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-fa5b8963-dca5-4939-b669-eb05e38335f4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:08.477399 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-fa5b8963-dca5-4939-b669-eb05e38335f4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:08.486095 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fa5b8963-dca5-4939-b669-eb05e38335f4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:08.486891 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fa5b8963-dca5-4939-b669-eb05e38335f4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:08.487973 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fa5b8963-dca5-4939-b669-eb05e38335f4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:08.488568 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fa5b8963-dca5-4939-b669-eb05e38335f4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:08.751760 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-fa5b8963-dca5-4939-b669-eb05e38335f4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:08.762348 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-fa5b8963-dca5-4939-b669-eb05e38335f4 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 200 len: 1513 microversion: 2.1 time: 0.289191 Nov 20 03:28:08.762955 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 392/708] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:28:08 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 1513 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:28:09.103344 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-a3da5ccd-8d40-41a2-a9ce-7d48f68e2206 req-bc4a2253-9357-48cf-9627-2c952dc7b303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b039039-82f2-411a-8b2f-39e31df51f77", "name": "network-vif-deleted", "tag": "6cabe651-4a25-4e86-bfd6-a1e07df36346"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:28:09.105026 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:28:09.105026 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:28:09.157842 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-a3da5ccd-8d40-41a2-a9ce-7d48f68e2206 req-bc4a2253-9357-48cf-9627-2c952dc7b303 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:09.160403 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-a3da5ccd-8d40-41a2-a9ce-7d48f68e2206 req-bc4a2253-9357-48cf-9627-2c952dc7b303 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:09.194505 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-a3da5ccd-8d40-41a2-a9ce-7d48f68e2206 req-bc4a2253-9357-48cf-9627-2c952dc7b303 service nova] Creating event network-vif-deleted:6cabe651-4a25-4e86-bfd6-a1e07df36346 for instance 3b039039-82f2-411a-8b2f-39e31df51f77 on hv-cinder-81803 Nov 20 03:28:09.210691 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-a3da5ccd-8d40-41a2-a9ce-7d48f68e2206 req-bc4a2253-9357-48cf-9627-2c952dc7b303 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110725 Nov 20 03:28:09.211898 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 317/709] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:28:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:28:09.783658 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-095a4296-9f48-40af-8b93-a8c3e06bb551 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:09.786461 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-095a4296-9f48-40af-8b93-a8c3e06bb551 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:09.795927 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-095a4296-9f48-40af-8b93-a8c3e06bb551 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:09.796718 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-095a4296-9f48-40af-8b93-a8c3e06bb551 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:09.797748 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-095a4296-9f48-40af-8b93-a8c3e06bb551 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:09.799014 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-095a4296-9f48-40af-8b93-a8c3e06bb551 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:09.910981 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-095a4296-9f48-40af-8b93-a8c3e06bb551 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:09.911642 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-095a4296-9f48-40af-8b93-a8c3e06bb551 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:09.912287 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.objects.instance [None req-095a4296-9f48-40af-8b93-a8c3e06bb551 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lazy-loading 'fault' on Instance uuid 3b039039-82f2-411a-8b2f-39e31df51f77 {{(pid=116113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 03:28:09.985554 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-095a4296-9f48-40af-8b93-a8c3e06bb551 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05b767f39ea49e4aa916c818a4290e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdf6e7abf574b269f3c1459a9d58c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:09.994713 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-095a4296-9f48-40af-8b93-a8c3e06bb551 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 200 len: 1306 microversion: 2.1 time: 0.218417 Nov 20 03:28:10.005214 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 393/710] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:28:09 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 1306 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:28:11.013209 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-8ba56e09-fffc-4392-bdfb-2cad7a35e780 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:11.014158 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-8ba56e09-fffc-4392-bdfb-2cad7a35e780 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] [instance: 3b039039-82f2-411a-8b2f-39e31df51f77] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:11.021567 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8ba56e09-fffc-4392-bdfb-2cad7a35e780 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:11.022276 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8ba56e09-fffc-4392-bdfb-2cad7a35e780 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:11.023585 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8ba56e09-fffc-4392-bdfb-2cad7a35e780 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:11.024403 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8ba56e09-fffc-4392-bdfb-2cad7a35e780 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:11.042501 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.wsgi [None req-8ba56e09-fffc-4392-bdfb-2cad7a35e780 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] HTTP exception thrown: Instance 3b039039-82f2-411a-8b2f-39e31df51f77 could not be found. Nov 20 03:28:11.044222 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-8ba56e09-fffc-4392-bdfb-2cad7a35e780 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] Returning 404 to user: Instance 3b039039-82f2-411a-8b2f-39e31df51f77 could not be found. {{(pid=116114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:28:11.045671 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-8ba56e09-fffc-4392-bdfb-2cad7a35e780 tempest-AttachVolumeNegativeTest-1235889435 tempest-AttachVolumeNegativeTest-1235889435-project] 10.222.0.37 "GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77" status: 404 len: 111 microversion: 2.1 time: 0.037631 Nov 20 03:28:11.046804 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 318/711] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:28:11 2021] GET /compute/v2.1/servers/3b039039-82f2-411a-8b2f-39e31df51f77 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:28:28.117877 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-e12521e3-1b6d-4275-be26-da6152d8b8c9 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-526572805", "imageRef": "e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0", "flavorRef": "452", "networks": [{"uuid": "86b72eeb-91ec-4820-a22e-ae047328594a"}]}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:28:28.179444 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.network.neutron [None req-e12521e3-1b6d-4275-be26-da6152d8b8c9 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] validate_networks() for [('86b72eeb-91ec-4820-a22e-ae047328594a', None, None, None, None, None)] {{(pid=116113) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 03:28:28.577029 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-e12521e3-1b6d-4275-be26-da6152d8b8c9 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Flavor limits 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 03:28:28.577677 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-e12521e3-1b6d-4275-be26-da6152d8b8c9 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Image limits 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 03:28:28.578381 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-e12521e3-1b6d-4275-be26-da6152d8b8c9 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Flavor pref 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 03:28:28.579138 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-e12521e3-1b6d-4275-be26-da6152d8b8c9 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Image pref 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 03:28:28.579766 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-e12521e3-1b6d-4275-be26-da6152d8b8c9 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 03:28:28.592732 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e12521e3-1b6d-4275-be26-da6152d8b8c9 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:28.593578 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e12521e3-1b6d-4275-be26-da6152d8b8c9 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:28.594602 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e12521e3-1b6d-4275-be26-da6152d8b8c9 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:28.595124 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e12521e3-1b6d-4275-be26-da6152d8b8c9 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:28.615912 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-e12521e3-1b6d-4275-be26-da6152d8b8c9 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Getting quotas for project fe445c6e096a48fc860957cb4adc25b2. Resources: {'ram', 'cores', 'instances'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:28:28.620288 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-e12521e3-1b6d-4275-be26-da6152d8b8c9 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Getting quotas for user d6bb4c48a413496c985d201933aad911 and project fe445c6e096a48fc860957cb4adc25b2. Resources: {'ram', 'cores', 'instances'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:28:28.641532 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-e12521e3-1b6d-4275-be26-da6152d8b8c9 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Going to run 1 instances... {{(pid=116113) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 03:28:28.643895 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-e12521e3-1b6d-4275-be26-da6152d8b8c9 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: d8c73da7-1d03-4af8-9786-356bb0e48249] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 03:28:28.693492 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-e12521e3-1b6d-4275-be26-da6152d8b8c9 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.584673 Nov 20 03:28:28.694769 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 394/712] 10.222.0.37 () {60 vars in 1146 bytes} [Sat Nov 20 03:28:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 03:28:28.704764 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-ec233426-bb04-4296-978f-cfa31b95162c tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:28.705976 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-ec233426-bb04-4296-978f-cfa31b95162c tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: d8c73da7-1d03-4af8-9786-356bb0e48249] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:28.766625 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-ec233426-bb04-4296-978f-cfa31b95162c tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:28.774320 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-ec233426-bb04-4296-978f-cfa31b95162c tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249" status: 200 len: 1218 microversion: 2.1 time: 0.073247 Nov 20 03:28:28.774870 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 319/713] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:28:28 2021] GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:28:29.790322 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-7a6cf29c-ac69-4bd2-9da0-29bf2ddce3e5 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:29.790929 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-7a6cf29c-ac69-4bd2-9da0-29bf2ddce3e5 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: d8c73da7-1d03-4af8-9786-356bb0e48249] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:29.797927 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7a6cf29c-ac69-4bd2-9da0-29bf2ddce3e5 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:29.798390 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7a6cf29c-ac69-4bd2-9da0-29bf2ddce3e5 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:29.799259 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7a6cf29c-ac69-4bd2-9da0-29bf2ddce3e5 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:29.799737 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7a6cf29c-ac69-4bd2-9da0-29bf2ddce3e5 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:29.924039 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-7a6cf29c-ac69-4bd2-9da0-29bf2ddce3e5 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:29.932563 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-7a6cf29c-ac69-4bd2-9da0-29bf2ddce3e5 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249" status: 200 len: 1278 microversion: 2.1 time: 0.145851 Nov 20 03:28:29.933216 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 395/714] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:28:29 2021] GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249 => generated 1278 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:28:30.952014 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-1270c13d-a211-42da-bd74-93b428ed2873 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:30.953125 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-1270c13d-a211-42da-bd74-93b428ed2873 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: d8c73da7-1d03-4af8-9786-356bb0e48249] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:30.961172 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1270c13d-a211-42da-bd74-93b428ed2873 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:30.961720 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1270c13d-a211-42da-bd74-93b428ed2873 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:30.962506 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1270c13d-a211-42da-bd74-93b428ed2873 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:30.962981 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1270c13d-a211-42da-bd74-93b428ed2873 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:31.093354 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-1270c13d-a211-42da-bd74-93b428ed2873 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:31.101122 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-1270c13d-a211-42da-bd74-93b428ed2873 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249" status: 200 len: 1318 microversion: 2.1 time: 0.154552 Nov 20 03:28:31.101692 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 320/715] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:28:30 2021] GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:28:31.313564 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-23e96af3-044e-482b-baf6-095200c24890 req-15aa98fe-7dd2-45c8-988e-3c0fce59aade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8c73da7-1d03-4af8-9786-356bb0e48249", "tag": "42866751-7c05-4c8c-97b5-ffc492d2081d"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:28:31.315104 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:28:31.315104 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:28:31.322776 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-23e96af3-044e-482b-baf6-095200c24890 req-15aa98fe-7dd2-45c8-988e-3c0fce59aade service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:31.323494 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-23e96af3-044e-482b-baf6-095200c24890 req-15aa98fe-7dd2-45c8-988e-3c0fce59aade service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:31.337711 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-23e96af3-044e-482b-baf6-095200c24890 req-15aa98fe-7dd2-45c8-988e-3c0fce59aade service nova] Creating event network-changed:42866751-7c05-4c8c-97b5-ffc492d2081d for instance d8c73da7-1d03-4af8-9786-356bb0e48249 on hv-cinder-81803 Nov 20 03:28:31.343060 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-23e96af3-044e-482b-baf6-095200c24890 req-15aa98fe-7dd2-45c8-988e-3c0fce59aade service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033415 Nov 20 03:28:31.344390 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 396/716] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:28:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:28:32.118102 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-18662ad9-19a5-4e7f-ab80-781f373b5f0c tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:32.118785 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-18662ad9-19a5-4e7f-ab80-781f373b5f0c tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: d8c73da7-1d03-4af8-9786-356bb0e48249] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:32.125372 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-18662ad9-19a5-4e7f-ab80-781f373b5f0c tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:32.125875 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-18662ad9-19a5-4e7f-ab80-781f373b5f0c tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:32.126747 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-18662ad9-19a5-4e7f-ab80-781f373b5f0c tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:32.127031 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-18662ad9-19a5-4e7f-ab80-781f373b5f0c tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:32.257398 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-18662ad9-19a5-4e7f-ab80-781f373b5f0c tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:32.264894 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-18662ad9-19a5-4e7f-ab80-781f373b5f0c tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249" status: 200 len: 1318 microversion: 2.1 time: 0.150302 Nov 20 03:28:32.265468 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 321/717] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:28:32 2021] GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:28:33.282228 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-10d5838c-e98c-423e-a113-00e310453452 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:33.282925 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-10d5838c-e98c-423e-a113-00e310453452 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: d8c73da7-1d03-4af8-9786-356bb0e48249] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:33.289569 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-10d5838c-e98c-423e-a113-00e310453452 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:33.290013 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-10d5838c-e98c-423e-a113-00e310453452 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:33.290780 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-10d5838c-e98c-423e-a113-00e310453452 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:33.291211 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-10d5838c-e98c-423e-a113-00e310453452 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:33.418311 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-10d5838c-e98c-423e-a113-00e310453452 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:33.425380 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-10d5838c-e98c-423e-a113-00e310453452 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249" status: 200 len: 1318 microversion: 2.1 time: 0.147585 Nov 20 03:28:33.425932 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 397/718] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:28:33 2021] GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:28:34.442677 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-5cfdb55c-0295-4b70-a3b5-dfa086d17525 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:34.443306 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-5cfdb55c-0295-4b70-a3b5-dfa086d17525 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: d8c73da7-1d03-4af8-9786-356bb0e48249] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:34.450137 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5cfdb55c-0295-4b70-a3b5-dfa086d17525 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:34.450585 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5cfdb55c-0295-4b70-a3b5-dfa086d17525 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:34.451368 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5cfdb55c-0295-4b70-a3b5-dfa086d17525 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:34.451813 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5cfdb55c-0295-4b70-a3b5-dfa086d17525 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:34.579634 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-5cfdb55c-0295-4b70-a3b5-dfa086d17525 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:34.587271 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-5cfdb55c-0295-4b70-a3b5-dfa086d17525 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249" status: 200 len: 1318 microversion: 2.1 time: 0.148152 Nov 20 03:28:34.588289 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 322/719] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:28:34 2021] GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:28:35.603537 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-71617ad3-ef2d-42f9-909c-d6e0217b8789 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:35.604307 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-71617ad3-ef2d-42f9-909c-d6e0217b8789 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: d8c73da7-1d03-4af8-9786-356bb0e48249] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:35.611434 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-71617ad3-ef2d-42f9-909c-d6e0217b8789 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:35.611916 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-71617ad3-ef2d-42f9-909c-d6e0217b8789 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:35.612729 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-71617ad3-ef2d-42f9-909c-d6e0217b8789 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:35.613164 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-71617ad3-ef2d-42f9-909c-d6e0217b8789 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:35.742558 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-71617ad3-ef2d-42f9-909c-d6e0217b8789 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:35.750438 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-71617ad3-ef2d-42f9-909c-d6e0217b8789 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249" status: 200 len: 1318 microversion: 2.1 time: 0.150460 Nov 20 03:28:35.751004 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 398/720] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:28:35 2021] GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:28:36.766696 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-d88d28d3-7a07-4d05-a3cf-2efaa215b1e3 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:36.767306 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-d88d28d3-7a07-4d05-a3cf-2efaa215b1e3 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: d8c73da7-1d03-4af8-9786-356bb0e48249] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:36.773682 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d88d28d3-7a07-4d05-a3cf-2efaa215b1e3 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:36.774131 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d88d28d3-7a07-4d05-a3cf-2efaa215b1e3 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:36.774910 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d88d28d3-7a07-4d05-a3cf-2efaa215b1e3 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:36.775353 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d88d28d3-7a07-4d05-a3cf-2efaa215b1e3 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:36.904285 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-d88d28d3-7a07-4d05-a3cf-2efaa215b1e3 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:36.911385 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-d88d28d3-7a07-4d05-a3cf-2efaa215b1e3 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249" status: 200 len: 1318 microversion: 2.1 time: 0.148318 Nov 20 03:28:36.911969 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 323/721] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:28:36 2021] GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:28:37.827669 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-a085b00b-06b2-4f58-960c-afc840e5c0d2 req-52659859-dedb-453b-b46d-72cf62b2aaea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8c73da7-1d03-4af8-9786-356bb0e48249", "name": "network-vif-plugged", "status": "completed", "tag": "42866751-7c05-4c8c-97b5-ffc492d2081d"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:28:37.829224 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:28:37.829224 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:28:37.837103 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-a085b00b-06b2-4f58-960c-afc840e5c0d2 req-52659859-dedb-453b-b46d-72cf62b2aaea service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:37.837584 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-a085b00b-06b2-4f58-960c-afc840e5c0d2 req-52659859-dedb-453b-b46d-72cf62b2aaea service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:37.851558 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-a085b00b-06b2-4f58-960c-afc840e5c0d2 req-52659859-dedb-453b-b46d-72cf62b2aaea service nova] Creating event network-vif-plugged:42866751-7c05-4c8c-97b5-ffc492d2081d for instance d8c73da7-1d03-4af8-9786-356bb0e48249 on hv-cinder-81803 Nov 20 03:28:37.856340 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-a085b00b-06b2-4f58-960c-afc840e5c0d2 req-52659859-dedb-453b-b46d-72cf62b2aaea service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032766 Nov 20 03:28:37.857111 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 399/722] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:28:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:28:37.928672 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-e81d4eb3-e81a-4ba2-a986-215286f6831e tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:37.929283 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-e81d4eb3-e81a-4ba2-a986-215286f6831e tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: d8c73da7-1d03-4af8-9786-356bb0e48249] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:37.936037 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e81d4eb3-e81a-4ba2-a986-215286f6831e tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:37.936494 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e81d4eb3-e81a-4ba2-a986-215286f6831e tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:37.937270 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e81d4eb3-e81a-4ba2-a986-215286f6831e tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:37.937711 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e81d4eb3-e81a-4ba2-a986-215286f6831e tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:38.066707 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-e81d4eb3-e81a-4ba2-a986-215286f6831e tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:38.074351 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-e81d4eb3-e81a-4ba2-a986-215286f6831e tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249" status: 200 len: 1318 microversion: 2.1 time: 0.148968 Nov 20 03:28:38.074916 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 324/723] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:28:37 2021] GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:28:39.092893 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ec69cbaa-4a65-440e-a3bb-6a2d41f906ed tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:39.093590 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ec69cbaa-4a65-440e-a3bb-6a2d41f906ed tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: d8c73da7-1d03-4af8-9786-356bb0e48249] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:39.100383 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ec69cbaa-4a65-440e-a3bb-6a2d41f906ed tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:39.100835 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ec69cbaa-4a65-440e-a3bb-6a2d41f906ed tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:39.101608 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ec69cbaa-4a65-440e-a3bb-6a2d41f906ed tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:39.102049 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ec69cbaa-4a65-440e-a3bb-6a2d41f906ed tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:39.480365 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-ec69cbaa-4a65-440e-a3bb-6a2d41f906ed tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:39.487561 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ec69cbaa-4a65-440e-a3bb-6a2d41f906ed tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249" status: 200 len: 1318 microversion: 2.1 time: 0.399152 Nov 20 03:28:39.488160 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 400/724] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:28:39 2021] GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249 => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:28:40.503962 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-f928b742-253b-48cb-b0e8-2db2b5c3bb98 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:40.504580 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-f928b742-253b-48cb-b0e8-2db2b5c3bb98 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: d8c73da7-1d03-4af8-9786-356bb0e48249] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:40.510874 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f928b742-253b-48cb-b0e8-2db2b5c3bb98 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:40.511333 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f928b742-253b-48cb-b0e8-2db2b5c3bb98 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:40.512144 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f928b742-253b-48cb-b0e8-2db2b5c3bb98 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:40.512583 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f928b742-253b-48cb-b0e8-2db2b5c3bb98 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:40.640380 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-f928b742-253b-48cb-b0e8-2db2b5c3bb98 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:40.647934 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-f928b742-253b-48cb-b0e8-2db2b5c3bb98 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249" status: 200 len: 1318 microversion: 2.1 time: 0.147461 Nov 20 03:28:40.648500 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 325/725] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:28:40 2021] GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:28:41.665160 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-1c14bf2b-ae0f-4e5b-bfb5-8071451c15d2 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:41.665701 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-1c14bf2b-ae0f-4e5b-bfb5-8071451c15d2 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: d8c73da7-1d03-4af8-9786-356bb0e48249] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:41.672481 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1c14bf2b-ae0f-4e5b-bfb5-8071451c15d2 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:41.672935 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1c14bf2b-ae0f-4e5b-bfb5-8071451c15d2 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:41.673708 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1c14bf2b-ae0f-4e5b-bfb5-8071451c15d2 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:41.674153 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1c14bf2b-ae0f-4e5b-bfb5-8071451c15d2 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:41.804653 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-1c14bf2b-ae0f-4e5b-bfb5-8071451c15d2 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:41.812510 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-1c14bf2b-ae0f-4e5b-bfb5-8071451c15d2 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249" status: 200 len: 1318 microversion: 2.1 time: 0.151132 Nov 20 03:28:41.813067 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 401/726] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:28:41 2021] GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:28:42.237129 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-96f6d64e-0f2c-4448-88ae-f02e4de9ba93 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:42.237670 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-96f6d64e-0f2c-4448-88ae-f02e4de9ba93 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:42.243642 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-96f6d64e-0f2c-4448-88ae-f02e4de9ba93 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:42.244133 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-96f6d64e-0f2c-4448-88ae-f02e4de9ba93 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:42.244912 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-96f6d64e-0f2c-4448-88ae-f02e4de9ba93 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:42.245375 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-96f6d64e-0f2c-4448-88ae-f02e4de9ba93 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:42.274220 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-96f6d64e-0f2c-4448-88ae-f02e4de9ba93 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/os-volume_attachments/1b1c693b-712c-4c08-838b-5001ed49f328" status: 200 len: 194 microversion: 2.20 time: 0.040895 Nov 20 03:28:42.274802 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 326/727] 10.222.0.37 () {60 vars in 1453 bytes} [Sat Nov 20 03:28:42 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/os-volume_attachments/1b1c693b-712c-4c08-838b-5001ed49f328 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:28:42.336389 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ac16969d-ce16-4511-9e4a-4b2661b231ee tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:42.336961 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ac16969d-ce16-4511-9e4a-4b2661b231ee tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:42.344404 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ac16969d-ce16-4511-9e4a-4b2661b231ee tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:42.345035 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ac16969d-ce16-4511-9e4a-4b2661b231ee tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:42.345837 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ac16969d-ce16-4511-9e4a-4b2661b231ee tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:42.346271 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ac16969d-ce16-4511-9e4a-4b2661b231ee tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:42.424141 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.objects.instance [None req-ac16969d-ce16-4511-9e4a-4b2661b231ee tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lazy-loading 'services' on Instance uuid f68eb618-c745-43db-a873-7c0700c0f11c {{(pid=116113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 03:28:42.494843 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ac16969d-ce16-4511-9e4a-4b2661b231ee tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "DELETE /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/os-volume_attachments/1b1c693b-712c-4c08-838b-5001ed49f328" status: 202 len: 0 microversion: 2.20 time: 0.162702 Nov 20 03:28:42.495513 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 402/728] 10.222.0.37 () {60 vars in 1456 bytes} [Sat Nov 20 03:28:42 2021] DELETE /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/os-volume_attachments/1b1c693b-712c-4c08-838b-5001ed49f328 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 20 03:28:42.504295 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-e4449155-cc28-4b47-beb7-6dba65f56c5d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:42.505229 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-e4449155-cc28-4b47-beb7-6dba65f56c5d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:42.512265 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e4449155-cc28-4b47-beb7-6dba65f56c5d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:42.512818 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e4449155-cc28-4b47-beb7-6dba65f56c5d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:42.513986 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e4449155-cc28-4b47-beb7-6dba65f56c5d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:42.514946 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e4449155-cc28-4b47-beb7-6dba65f56c5d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:42.546029 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-e4449155-cc28-4b47-beb7-6dba65f56c5d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046001 Nov 20 03:28:42.546595 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 327/729] 10.222.0.37 () {60 vars in 1342 bytes} [Sat Nov 20 03:28:42 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:28:42.829889 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-a0be9417-60be-459e-9215-b91a293fad3d tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:42.830814 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-a0be9417-60be-459e-9215-b91a293fad3d tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: d8c73da7-1d03-4af8-9786-356bb0e48249] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:42.837426 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a0be9417-60be-459e-9215-b91a293fad3d tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:42.838237 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a0be9417-60be-459e-9215-b91a293fad3d tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:42.839151 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a0be9417-60be-459e-9215-b91a293fad3d tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:42.840005 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a0be9417-60be-459e-9215-b91a293fad3d tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:42.999279 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a0be9417-60be-459e-9215-b91a293fad3d tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:43.008382 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-a0be9417-60be-459e-9215-b91a293fad3d tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249" status: 200 len: 1318 microversion: 2.1 time: 0.182892 Nov 20 03:28:43.018891 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 403/730] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:28:42 2021] GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:28:43.559329 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-c5605467-3e19-42ff-98dc-f0a5d98d9b5e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:43.560457 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-c5605467-3e19-42ff-98dc-f0a5d98d9b5e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:43.566889 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c5605467-3e19-42ff-98dc-f0a5d98d9b5e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:43.567344 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c5605467-3e19-42ff-98dc-f0a5d98d9b5e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:43.568158 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c5605467-3e19-42ff-98dc-f0a5d98d9b5e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:43.568593 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c5605467-3e19-42ff-98dc-f0a5d98d9b5e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:43.599006 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-c5605467-3e19-42ff-98dc-f0a5d98d9b5e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044278 Nov 20 03:28:43.599533 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 328/731] 10.222.0.37 () {60 vars in 1342 bytes} [Sat Nov 20 03:28:43 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:28:44.025600 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-8dd1ffdd-da94-4399-8e47-a1ed37a0e087 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:44.026220 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-8dd1ffdd-da94-4399-8e47-a1ed37a0e087 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: d8c73da7-1d03-4af8-9786-356bb0e48249] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:44.032553 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8dd1ffdd-da94-4399-8e47-a1ed37a0e087 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:44.033007 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8dd1ffdd-da94-4399-8e47-a1ed37a0e087 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:44.033783 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8dd1ffdd-da94-4399-8e47-a1ed37a0e087 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:44.034224 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8dd1ffdd-da94-4399-8e47-a1ed37a0e087 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:44.170553 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-8dd1ffdd-da94-4399-8e47-a1ed37a0e087 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:44.179441 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-8dd1ffdd-da94-4399-8e47-a1ed37a0e087 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249" status: 200 len: 1506 microversion: 2.1 time: 0.157398 Nov 20 03:28:44.189201 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 404/732] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:28:44 2021] GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:28:44.611012 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-a92ccada-e5ad-4a30-aed8-19cdcbed9872 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:44.612199 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-a92ccada-e5ad-4a30-aed8-19cdcbed9872 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:44.618600 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a92ccada-e5ad-4a30-aed8-19cdcbed9872 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:44.618999 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a92ccada-e5ad-4a30-aed8-19cdcbed9872 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:44.620168 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a92ccada-e5ad-4a30-aed8-19cdcbed9872 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:44.620714 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a92ccada-e5ad-4a30-aed8-19cdcbed9872 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:44.654473 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-a92ccada-e5ad-4a30-aed8-19cdcbed9872 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047731 Nov 20 03:28:44.655041 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 329/733] 10.222.0.37 () {60 vars in 1342 bytes} [Sat Nov 20 03:28:44 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:28:44.710725 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-050f6a58-b763-4004-ab70-2de8eac48bdb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:44.711255 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-050f6a58-b763-4004-ab70-2de8eac48bdb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:44.717072 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-050f6a58-b763-4004-ab70-2de8eac48bdb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:44.717516 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-050f6a58-b763-4004-ab70-2de8eac48bdb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:44.718280 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-050f6a58-b763-4004-ab70-2de8eac48bdb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:44.718711 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-050f6a58-b763-4004-ab70-2de8eac48bdb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:44.745934 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-050f6a58-b763-4004-ab70-2de8eac48bdb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Going to try to terminate instance {{(pid=116113) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 03:28:44.821116 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-050f6a58-b763-4004-ab70-2de8eac48bdb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "DELETE /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 204 len: 0 microversion: 2.20 time: 0.113997 Nov 20 03:28:44.821714 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 405/734] 10.222.0.37 () {60 vars in 1279 bytes} [Sat Nov 20 03:28:44 2021] DELETE /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 20 03:28:44.830804 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-a541173c-5c40-44f9-9203-5f6ecfb42800 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:44.831403 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-a541173c-5c40-44f9-9203-5f6ecfb42800 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:44.837504 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a541173c-5c40-44f9-9203-5f6ecfb42800 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:44.837954 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a541173c-5c40-44f9-9203-5f6ecfb42800 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:44.838729 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a541173c-5c40-44f9-9203-5f6ecfb42800 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:44.839199 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a541173c-5c40-44f9-9203-5f6ecfb42800 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:44.970577 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-a541173c-5c40-44f9-9203-5f6ecfb42800 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:44.986601 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-a541173c-5c40-44f9-9203-5f6ecfb42800 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:44.988767 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-a541173c-5c40-44f9-9203-5f6ecfb42800 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:44.989485 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-a541173c-5c40-44f9-9203-5f6ecfb42800 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1724 microversion: 2.20 time: 0.163331 Nov 20 03:28:44.990036 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 330/735] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:28:44 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:28:46.008460 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-9d99bc3e-05cd-4997-9f33-2f27034f637a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:46.009114 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-9d99bc3e-05cd-4997-9f33-2f27034f637a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:46.015971 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9d99bc3e-05cd-4997-9f33-2f27034f637a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:46.016422 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9d99bc3e-05cd-4997-9f33-2f27034f637a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:46.017196 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9d99bc3e-05cd-4997-9f33-2f27034f637a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:46.017631 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9d99bc3e-05cd-4997-9f33-2f27034f637a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:46.148132 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9d99bc3e-05cd-4997-9f33-2f27034f637a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:46.155900 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9d99bc3e-05cd-4997-9f33-2f27034f637a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:46.157438 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9d99bc3e-05cd-4997-9f33-2f27034f637a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:46.158577 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-9d99bc3e-05cd-4997-9f33-2f27034f637a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1724 microversion: 2.20 time: 0.154314 Nov 20 03:28:46.159134 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 406/736] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:28:46 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:28:47.188372 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-590ef14d-2932-49a6-9820-02f4c86ff565 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:47.191618 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-590ef14d-2932-49a6-9820-02f4c86ff565 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:47.208265 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-590ef14d-2932-49a6-9820-02f4c86ff565 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:47.209067 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-590ef14d-2932-49a6-9820-02f4c86ff565 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:47.210498 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-590ef14d-2932-49a6-9820-02f4c86ff565 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:47.211742 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-590ef14d-2932-49a6-9820-02f4c86ff565 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:47.439822 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-590ef14d-2932-49a6-9820-02f4c86ff565 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:47.447687 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-590ef14d-2932-49a6-9820-02f4c86ff565 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:47.449792 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-590ef14d-2932-49a6-9820-02f4c86ff565 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:47.451039 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-590ef14d-2932-49a6-9820-02f4c86ff565 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 200 len: 1724 microversion: 2.20 time: 0.268444 Nov 20 03:28:47.451680 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 331/737] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:28:47 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:28:47.827187 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-d177be77-b96a-4752-aaa2-4fe172fd3889 req-71d84c26-f617-4ede-a469-e9dd166a84ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f68eb618-c745-43db-a873-7c0700c0f11c", "name": "network-vif-deleted", "tag": "7a19e0fe-867b-45fc-9ef7-f883f1a8dbd9"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:28:47.829272 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:28:47.829272 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:28:47.850175 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-d177be77-b96a-4752-aaa2-4fe172fd3889 req-71d84c26-f617-4ede-a469-e9dd166a84ce service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:47.850883 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-d177be77-b96a-4752-aaa2-4fe172fd3889 req-71d84c26-f617-4ede-a469-e9dd166a84ce service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:47.866963 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-d177be77-b96a-4752-aaa2-4fe172fd3889 req-71d84c26-f617-4ede-a469-e9dd166a84ce service nova] Creating event network-vif-deleted:7a19e0fe-867b-45fc-9ef7-f883f1a8dbd9 for instance f68eb618-c745-43db-a873-7c0700c0f11c on hv-cinder-81803 Nov 20 03:28:47.872429 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-d177be77-b96a-4752-aaa2-4fe172fd3889 req-71d84c26-f617-4ede-a469-e9dd166a84ce service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054452 Nov 20 03:28:47.873098 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 407/738] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:28:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:28:48.473101 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-aeee6b3e-56b6-4374-8455-e3d6f3c794a9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:48.474539 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-aeee6b3e-56b6-4374-8455-e3d6f3c794a9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:48.485184 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-aeee6b3e-56b6-4374-8455-e3d6f3c794a9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:48.486055 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-aeee6b3e-56b6-4374-8455-e3d6f3c794a9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:48.487086 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-aeee6b3e-56b6-4374-8455-e3d6f3c794a9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:48.487917 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-aeee6b3e-56b6-4374-8455-e3d6f3c794a9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:48.510089 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.wsgi [None req-aeee6b3e-56b6-4374-8455-e3d6f3c794a9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] HTTP exception thrown: Instance f68eb618-c745-43db-a873-7c0700c0f11c could not be found. Nov 20 03:28:48.511566 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-aeee6b3e-56b6-4374-8455-e3d6f3c794a9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Returning 404 to user: Instance f68eb618-c745-43db-a873-7c0700c0f11c could not be found. {{(pid=116114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:28:48.512459 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-aeee6b3e-56b6-4374-8455-e3d6f3c794a9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 404 len: 111 microversion: 2.20 time: 0.046524 Nov 20 03:28:48.523619 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-760e179c-cd7f-4cfb-9245-646670d1198f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '.version_select at 0x7f2dac8a8940>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:48.527414 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: ERROR oslo.messaging._drivers.impl_rabbit [None req-760e179c-cd7f-4cfb-9245-646670d1198f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [121183cd-7756-42e7-a6f9-74456208bce8] AMQP server on 10.222.0.37:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 20 03:28:48.528080 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 332/739] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:28:48 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 20 03:28:49.546245 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO oslo.messaging._drivers.impl_rabbit [None req-760e179c-cd7f-4cfb-9245-646670d1198f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [121183cd-7756-42e7-a6f9-74456208bce8] Reconnected to AMQP server on 10.222.0.37:5672 via [amqp] client with port 43026. Nov 20 03:28:49.566833 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-760e179c-cd7f-4cfb-9245-646670d1198f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2104450247" status: 204 len: 0 microversion: 2.20 time: 1.048436 Nov 20 03:28:49.567613 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 408/740] 10.222.0.37 () {60 vars in 1261 bytes} [Sat Nov 20 03:28:48 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2104450247 => generated 0 bytes in 1050 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 20 03:28:50.361159 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-cff5bae6-f1c0-45f7-9daa-aa779ea99bd2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'create', calling method: .version_select at 0x7f2dac94e5e0>, body: {"keypair": {"name": "tempest-keypair-1229318093"}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:28:50.375393 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-cff5bae6-f1c0-45f7-9daa-aa779ea99bd2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Getting quotas for project 8abd5d5840ac400c82604d0212b124f2. Resources: {'key_pairs'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:28:50.379563 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-cff5bae6-f1c0-45f7-9daa-aa779ea99bd2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Getting quotas for user 7036f594f5e1419a8f12e6657de1ffb9 and project 8abd5d5840ac400c82604d0212b124f2. Resources: {'key_pairs'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:28:50.532600 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-cff5bae6-f1c0-45f7-9daa-aa779ea99bd2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Getting quotas for project 8abd5d5840ac400c82604d0212b124f2. Resources: {'key_pairs'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:28:50.536295 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-cff5bae6-f1c0-45f7-9daa-aa779ea99bd2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Getting quotas for user 7036f594f5e1419a8f12e6657de1ffb9 and project 8abd5d5840ac400c82604d0212b124f2. Resources: {'key_pairs'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:28:50.550188 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-cff5bae6-f1c0-45f7-9daa-aa779ea99bd2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.192753 Nov 20 03:28:50.550774 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 333/741] 10.222.0.37 () {62 vars in 1198 bytes} [Sat Nov 20 03:28:50 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 194 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 20 03:28:51.902616 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-700f2cbe-70e2-414b-941b-88203b07d1cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-104885923", "imageRef": "e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3ac0da1c-dc79-4675-9f0a-2d0c06da492e"}], "security_groups": [{"name": "tempest-securitygroup--74198708"}], "key_name": "tempest-keypair-1229318093", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:28:52.055560 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.network.neutron [None req-700f2cbe-70e2-414b-941b-88203b07d1cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] validate_networks() for [('3ac0da1c-dc79-4675-9f0a-2d0c06da492e', None, None, None, None, None)] {{(pid=116113) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 03:28:52.469077 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-700f2cbe-70e2-414b-941b-88203b07d1cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Flavor limits 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 03:28:52.469501 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-700f2cbe-70e2-414b-941b-88203b07d1cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Image limits 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 03:28:52.470126 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-700f2cbe-70e2-414b-941b-88203b07d1cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Flavor pref 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 03:28:52.470573 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-700f2cbe-70e2-414b-941b-88203b07d1cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Image pref 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 03:28:52.471125 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-700f2cbe-70e2-414b-941b-88203b07d1cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 03:28:52.480397 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-700f2cbe-70e2-414b-941b-88203b07d1cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:52.481141 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-700f2cbe-70e2-414b-941b-88203b07d1cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:52.481962 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-700f2cbe-70e2-414b-941b-88203b07d1cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:52.482400 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-700f2cbe-70e2-414b-941b-88203b07d1cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:52.499740 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-700f2cbe-70e2-414b-941b-88203b07d1cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Getting quotas for project 8abd5d5840ac400c82604d0212b124f2. Resources: {'ram', 'cores', 'instances'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:28:52.503570 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-700f2cbe-70e2-414b-941b-88203b07d1cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Getting quotas for user 7036f594f5e1419a8f12e6657de1ffb9 and project 8abd5d5840ac400c82604d0212b124f2. Resources: {'ram', 'cores', 'instances'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:28:52.514808 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-700f2cbe-70e2-414b-941b-88203b07d1cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Going to run 1 instances... {{(pid=116113) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 03:28:52.517254 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-700f2cbe-70e2-414b-941b-88203b07d1cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 03:28:52.565387 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-700f2cbe-70e2-414b-941b-88203b07d1cf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.667797 Nov 20 03:28:52.566209 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 409/742] 10.222.0.37 () {62 vars in 1187 bytes} [Sat Nov 20 03:28:51 2021] POST /compute/v2.1/servers => generated 400 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 20 03:28:52.576801 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-f20a93c5-4f79-41e7-ab55-cf208f2c45aa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:52.577586 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-f20a93c5-4f79-41e7-ab55-cf208f2c45aa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:52.635288 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-f20a93c5-4f79-41e7-ab55-cf208f2c45aa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:52.642795 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-f20a93c5-4f79-41e7-ab55-cf208f2c45aa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:52.644341 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-f20a93c5-4f79-41e7-ab55-cf208f2c45aa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:52.645446 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-f20a93c5-4f79-41e7-ab55-cf208f2c45aa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1281 microversion: 2.20 time: 0.073271 Nov 20 03:28:52.646040 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 334/743] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:28:52 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:28:53.664787 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-bb2c84b3-4eb1-42bc-8e7a-786ce4b6a60d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:53.665399 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-bb2c84b3-4eb1-42bc-8e7a-786ce4b6a60d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:53.673135 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bb2c84b3-4eb1-42bc-8e7a-786ce4b6a60d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:53.673827 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bb2c84b3-4eb1-42bc-8e7a-786ce4b6a60d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:53.674616 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bb2c84b3-4eb1-42bc-8e7a-786ce4b6a60d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:53.675057 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bb2c84b3-4eb1-42bc-8e7a-786ce4b6a60d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:53.747461 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-bb2c84b3-4eb1-42bc-8e7a-786ce4b6a60d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:53.756100 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-bb2c84b3-4eb1-42bc-8e7a-786ce4b6a60d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:53.758314 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-bb2c84b3-4eb1-42bc-8e7a-786ce4b6a60d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:53.759670 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-bb2c84b3-4eb1-42bc-8e7a-786ce4b6a60d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1341 microversion: 2.20 time: 0.098623 Nov 20 03:28:53.760435 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 410/744] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:28:53 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1341 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:28:54.779255 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-e8bf917b-5bd2-469d-8b59-03918ea554d6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:54.779938 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-e8bf917b-5bd2-469d-8b59-03918ea554d6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:54.788712 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e8bf917b-5bd2-469d-8b59-03918ea554d6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:54.790530 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e8bf917b-5bd2-469d-8b59-03918ea554d6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:54.791857 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e8bf917b-5bd2-469d-8b59-03918ea554d6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:54.792311 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e8bf917b-5bd2-469d-8b59-03918ea554d6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:55.297884 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-e8bf917b-5bd2-469d-8b59-03918ea554d6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:55.305973 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-e8bf917b-5bd2-469d-8b59-03918ea554d6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:55.308260 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-e8bf917b-5bd2-469d-8b59-03918ea554d6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:55.309481 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-e8bf917b-5bd2-469d-8b59-03918ea554d6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1405 microversion: 2.20 time: 0.534511 Nov 20 03:28:55.310122 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 335/745] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:28:54 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1405 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:28:55.464750 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-1bdaae7b-da99-41d3-8148-da716e2b321c req-dbe7ea10-107c-433c-a17b-d40ed371cfd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eea9197b-774d-4dc7-9461-3a5ab4e5e7a0", "tag": "09e4f458-7d7a-4be0-87eb-4f821050a3c3"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:28:55.473188 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:28:55.473188 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:28:55.493910 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-1bdaae7b-da99-41d3-8148-da716e2b321c req-dbe7ea10-107c-433c-a17b-d40ed371cfd3 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:55.494550 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-1bdaae7b-da99-41d3-8148-da716e2b321c req-dbe7ea10-107c-433c-a17b-d40ed371cfd3 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:55.507454 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-1bdaae7b-da99-41d3-8148-da716e2b321c req-dbe7ea10-107c-433c-a17b-d40ed371cfd3 service nova] Creating event network-changed:09e4f458-7d7a-4be0-87eb-4f821050a3c3 for instance eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 on hv-cinder-81803 Nov 20 03:28:55.512963 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-1bdaae7b-da99-41d3-8148-da716e2b321c req-dbe7ea10-107c-433c-a17b-d40ed371cfd3 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055122 Nov 20 03:28:55.514504 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 411/746] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:28:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:28:56.335639 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-7476f2ea-20dc-4dfa-96fd-5147da9fa320 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:56.338295 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-7476f2ea-20dc-4dfa-96fd-5147da9fa320 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:56.353178 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7476f2ea-20dc-4dfa-96fd-5147da9fa320 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:56.353964 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7476f2ea-20dc-4dfa-96fd-5147da9fa320 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:56.355203 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7476f2ea-20dc-4dfa-96fd-5147da9fa320 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:56.355857 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7476f2ea-20dc-4dfa-96fd-5147da9fa320 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:56.618422 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-7476f2ea-20dc-4dfa-96fd-5147da9fa320 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:56.628758 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-7476f2ea-20dc-4dfa-96fd-5147da9fa320 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:56.630667 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-7476f2ea-20dc-4dfa-96fd-5147da9fa320 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:56.632624 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-7476f2ea-20dc-4dfa-96fd-5147da9fa320 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1405 microversion: 2.20 time: 0.305583 Nov 20 03:28:56.633197 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 336/747] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:28:56 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1405 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:28:57.652520 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-f11fcd13-a287-470a-95ac-9f2fb30e369b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:57.653210 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f11fcd13-a287-470a-95ac-9f2fb30e369b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:57.661763 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f11fcd13-a287-470a-95ac-9f2fb30e369b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:57.662478 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f11fcd13-a287-470a-95ac-9f2fb30e369b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:57.663263 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f11fcd13-a287-470a-95ac-9f2fb30e369b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:57.663694 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f11fcd13-a287-470a-95ac-9f2fb30e369b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:57.844513 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-f11fcd13-a287-470a-95ac-9f2fb30e369b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:57.853382 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-f11fcd13-a287-470a-95ac-9f2fb30e369b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:57.855018 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-f11fcd13-a287-470a-95ac-9f2fb30e369b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:57.856206 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-f11fcd13-a287-470a-95ac-9f2fb30e369b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1405 microversion: 2.20 time: 0.209446 Nov 20 03:28:57.856761 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 412/748] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:28:57 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1405 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:28:58.875061 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-65f9b504-4780-4e54-88d9-13ab7b5fc3df tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:28:58.876419 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-65f9b504-4780-4e54-88d9-13ab7b5fc3df tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:28:58.883740 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-65f9b504-4780-4e54-88d9-13ab7b5fc3df tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:58.884248 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-65f9b504-4780-4e54-88d9-13ab7b5fc3df tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:58.885068 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-65f9b504-4780-4e54-88d9-13ab7b5fc3df tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:28:58.886087 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-65f9b504-4780-4e54-88d9-13ab7b5fc3df tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:28:59.030547 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-65f9b504-4780-4e54-88d9-13ab7b5fc3df tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:59.042026 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-65f9b504-4780-4e54-88d9-13ab7b5fc3df tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:59.043649 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-65f9b504-4780-4e54-88d9-13ab7b5fc3df tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:28:59.044885 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-65f9b504-4780-4e54-88d9-13ab7b5fc3df tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1405 microversion: 2.20 time: 0.174542 Nov 20 03:28:59.045506 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 337/749] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:28:58 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:29:00.064469 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-9920389d-9644-434c-9cdf-1e64cf833e5a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:00.065181 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-9920389d-9644-434c-9cdf-1e64cf833e5a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:00.073345 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9920389d-9644-434c-9cdf-1e64cf833e5a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:00.073946 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9920389d-9644-434c-9cdf-1e64cf833e5a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:00.074847 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9920389d-9644-434c-9cdf-1e64cf833e5a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:00.075488 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9920389d-9644-434c-9cdf-1e64cf833e5a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:00.235234 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9920389d-9644-434c-9cdf-1e64cf833e5a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:00.243059 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9920389d-9644-434c-9cdf-1e64cf833e5a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:00.245120 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9920389d-9644-434c-9cdf-1e64cf833e5a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:00.246224 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-9920389d-9644-434c-9cdf-1e64cf833e5a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1405 microversion: 2.20 time: 0.185754 Nov 20 03:29:00.246780 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 413/750] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:29:00 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1405 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:29:00.342181 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-dbf951b3-1a39-4f52-87c4-cb28113b9907 req-e05a926c-c885-4cbe-b98c-9b174fe2828c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea9197b-774d-4dc7-9461-3a5ab4e5e7a0", "name": "network-vif-plugged", "status": "completed", "tag": "09e4f458-7d7a-4be0-87eb-4f821050a3c3"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:00.344117 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:29:00.344117 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:29:00.357903 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-dbf951b3-1a39-4f52-87c4-cb28113b9907 req-e05a926c-c885-4cbe-b98c-9b174fe2828c service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:00.357903 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-dbf951b3-1a39-4f52-87c4-cb28113b9907 req-e05a926c-c885-4cbe-b98c-9b174fe2828c service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:00.368111 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-dbf951b3-1a39-4f52-87c4-cb28113b9907 req-e05a926c-c885-4cbe-b98c-9b174fe2828c service nova] Creating event network-vif-plugged:09e4f458-7d7a-4be0-87eb-4f821050a3c3 for instance eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 on hv-cinder-81803 Nov 20 03:29:00.373807 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-dbf951b3-1a39-4f52-87c4-cb28113b9907 req-e05a926c-c885-4cbe-b98c-9b174fe2828c service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036304 Nov 20 03:29:00.374397 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 338/751] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:29:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:29:01.265213 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-10ae6312-8d1a-4068-b417-24bbd4fd9d3d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:01.265784 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-10ae6312-8d1a-4068-b417-24bbd4fd9d3d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:01.272010 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-10ae6312-8d1a-4068-b417-24bbd4fd9d3d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:01.272464 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-10ae6312-8d1a-4068-b417-24bbd4fd9d3d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:01.273307 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-10ae6312-8d1a-4068-b417-24bbd4fd9d3d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:01.273747 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-10ae6312-8d1a-4068-b417-24bbd4fd9d3d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:01.408723 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-10ae6312-8d1a-4068-b417-24bbd4fd9d3d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:01.416800 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-10ae6312-8d1a-4068-b417-24bbd4fd9d3d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:01.418294 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-10ae6312-8d1a-4068-b417-24bbd4fd9d3d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:01.419475 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-10ae6312-8d1a-4068-b417-24bbd4fd9d3d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1405 microversion: 2.20 time: 0.158103 Nov 20 03:29:01.420085 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 414/752] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:29:01 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:29:02.438484 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-fc770073-997c-4105-812b-7fbff6ec9226 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:02.439864 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-fc770073-997c-4105-812b-7fbff6ec9226 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:02.445905 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fc770073-997c-4105-812b-7fbff6ec9226 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:02.446434 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fc770073-997c-4105-812b-7fbff6ec9226 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:02.447308 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fc770073-997c-4105-812b-7fbff6ec9226 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:02.447877 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fc770073-997c-4105-812b-7fbff6ec9226 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:02.652395 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-fc770073-997c-4105-812b-7fbff6ec9226 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:02.660738 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-fc770073-997c-4105-812b-7fbff6ec9226 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:02.662529 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-fc770073-997c-4105-812b-7fbff6ec9226 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:02.663806 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-fc770073-997c-4105-812b-7fbff6ec9226 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1597 microversion: 2.20 time: 0.229895 Nov 20 03:29:02.664483 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 339/753] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:29:02 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1597 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:29:02.681566 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-a716cee4-c6f5-49b2-847e-c7d6dbe26ee3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:02.682173 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-a716cee4-c6f5-49b2-847e-c7d6dbe26ee3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:02.689168 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a716cee4-c6f5-49b2-847e-c7d6dbe26ee3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:02.689945 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a716cee4-c6f5-49b2-847e-c7d6dbe26ee3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:02.690760 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a716cee4-c6f5-49b2-847e-c7d6dbe26ee3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:02.691232 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a716cee4-c6f5-49b2-847e-c7d6dbe26ee3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:02.789587 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-a716cee4-c6f5-49b2-847e-c7d6dbe26ee3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.111740 Nov 20 03:29:02.790812 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 415/754] 10.222.0.37 () {60 vars in 1315 bytes} [Sat Nov 20 03:29:02 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:29:03.844900 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-9c29e0d3-2334-4900-a4ed-843b39408727 req-305b973d-3276-4aee-92a5-6b58e77f1734 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eea9197b-774d-4dc7-9461-3a5ab4e5e7a0", "tag": "09e4f458-7d7a-4be0-87eb-4f821050a3c3"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:03.845524 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-546d5c6f-068d-4990-90b6-ec71bceafe01 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:03.846355 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-546d5c6f-068d-4990-90b6-ec71bceafe01 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:03.846999 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:29:03.846999 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:29:03.857795 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-9c29e0d3-2334-4900-a4ed-843b39408727 req-305b973d-3276-4aee-92a5-6b58e77f1734 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:03.857795 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-9c29e0d3-2334-4900-a4ed-843b39408727 req-305b973d-3276-4aee-92a5-6b58e77f1734 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:03.860374 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-546d5c6f-068d-4990-90b6-ec71bceafe01 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:03.863642 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-546d5c6f-068d-4990-90b6-ec71bceafe01 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:03.865785 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-546d5c6f-068d-4990-90b6-ec71bceafe01 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:03.866364 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-546d5c6f-068d-4990-90b6-ec71bceafe01 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:03.871853 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-9c29e0d3-2334-4900-a4ed-843b39408727 req-305b973d-3276-4aee-92a5-6b58e77f1734 service nova] Creating event network-changed:09e4f458-7d7a-4be0-87eb-4f821050a3c3 for instance eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 on hv-cinder-81803 Nov 20 03:29:03.877171 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-9c29e0d3-2334-4900-a4ed-843b39408727 req-305b973d-3276-4aee-92a5-6b58e77f1734 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035826 Nov 20 03:29:03.878386 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 416/755] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:29:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:29:03.986389 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-546d5c6f-068d-4990-90b6-ec71bceafe01 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 200 len: 14 microversion: 2.20 time: 0.149090 Nov 20 03:29:03.990396 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 340/756] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:29:03 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:04.999541 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-584384ae-fe47-43a7-88e0-c719c5664efa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:05.000718 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-584384ae-fe47-43a7-88e0-c719c5664efa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:05.007986 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-584384ae-fe47-43a7-88e0-c719c5664efa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:05.008517 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-584384ae-fe47-43a7-88e0-c719c5664efa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:05.009333 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-584384ae-fe47-43a7-88e0-c719c5664efa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:05.012531 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-584384ae-fe47-43a7-88e0-c719c5664efa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:05.103275 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-584384ae-fe47-43a7-88e0-c719c5664efa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 200 len: 14 microversion: 2.20 time: 0.109029 Nov 20 03:29:05.104056 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 417/757] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:29:04 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:05.730744 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-d9d49b28-9505-48ff-90fc-4e989c57e6a4 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d53055e0-e6b4-4785-b25d-eb27e93d08d7", "device": "/dev/sdb"}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:05.732550 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-d9d49b28-9505-48ff-90fc-4e989c57e6a4 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: d8c73da7-1d03-4af8-9786-356bb0e48249] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:05.739385 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d9d49b28-9505-48ff-90fc-4e989c57e6a4 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:05.740028 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d9d49b28-9505-48ff-90fc-4e989c57e6a4 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:05.741039 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d9d49b28-9505-48ff-90fc-4e989c57e6a4 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:05.741498 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d9d49b28-9505-48ff-90fc-4e989c57e6a4 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:05.987399 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-d9d49b28-9505-48ff-90fc-4e989c57e6a4 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "POST /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261864 Nov 20 03:29:05.988052 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 341/758] 10.222.0.37 () {60 vars in 1322 bytes} [Sat Nov 20 03:29:05 2021] POST /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:29:06.114849 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-351d20bd-2dd9-4cb9-9cfd-ee699790ce53 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:06.115908 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-351d20bd-2dd9-4cb9-9cfd-ee699790ce53 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:06.123147 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-351d20bd-2dd9-4cb9-9cfd-ee699790ce53 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:06.123624 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-351d20bd-2dd9-4cb9-9cfd-ee699790ce53 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:06.124444 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-351d20bd-2dd9-4cb9-9cfd-ee699790ce53 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:06.124877 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-351d20bd-2dd9-4cb9-9cfd-ee699790ce53 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:06.220831 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-351d20bd-2dd9-4cb9-9cfd-ee699790ce53 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 200 len: 14 microversion: 2.20 time: 0.109708 Nov 20 03:29:06.221396 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 418/759] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:29:06 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:07.234846 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-3df9aed8-9ce7-4bc8-a470-adc6853d94a8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:07.235939 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-3df9aed8-9ce7-4bc8-a470-adc6853d94a8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:07.242233 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3df9aed8-9ce7-4bc8-a470-adc6853d94a8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:07.242684 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3df9aed8-9ce7-4bc8-a470-adc6853d94a8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:07.243596 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3df9aed8-9ce7-4bc8-a470-adc6853d94a8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:07.244182 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3df9aed8-9ce7-4bc8-a470-adc6853d94a8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:07.326845 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-3df9aed8-9ce7-4bc8-a470-adc6853d94a8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 200 len: 14 microversion: 2.20 time: 0.098316 Nov 20 03:29:07.327396 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 342/760] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:29:07 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:08.338425 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-27ad5d3f-7b9a-4c24-af44-81f03960f287 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:08.339530 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-27ad5d3f-7b9a-4c24-af44-81f03960f287 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:08.346904 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-27ad5d3f-7b9a-4c24-af44-81f03960f287 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:08.347434 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-27ad5d3f-7b9a-4c24-af44-81f03960f287 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:08.348351 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-27ad5d3f-7b9a-4c24-af44-81f03960f287 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:08.348869 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-27ad5d3f-7b9a-4c24-af44-81f03960f287 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:08.436268 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-27ad5d3f-7b9a-4c24-af44-81f03960f287 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 200 len: 14 microversion: 2.20 time: 0.101090 Nov 20 03:29:08.437482 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 419/761] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:29:08 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:09.447038 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-25133006-cd23-4730-87e9-f37ca6de6e42 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:09.448456 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-25133006-cd23-4730-87e9-f37ca6de6e42 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:09.455176 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-25133006-cd23-4730-87e9-f37ca6de6e42 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:09.455621 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-25133006-cd23-4730-87e9-f37ca6de6e42 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:09.456404 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-25133006-cd23-4730-87e9-f37ca6de6e42 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:09.456834 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-25133006-cd23-4730-87e9-f37ca6de6e42 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:09.547201 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-25133006-cd23-4730-87e9-f37ca6de6e42 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 200 len: 14 microversion: 2.20 time: 0.104121 Nov 20 03:29:09.547890 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 343/762] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:29:09 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:10.558657 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-cfbee806-c704-445f-bcac-0cd46e33b461 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:10.559709 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-cfbee806-c704-445f-bcac-0cd46e33b461 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:10.566899 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cfbee806-c704-445f-bcac-0cd46e33b461 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:10.567356 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cfbee806-c704-445f-bcac-0cd46e33b461 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:10.568160 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cfbee806-c704-445f-bcac-0cd46e33b461 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:10.568595 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cfbee806-c704-445f-bcac-0cd46e33b461 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:10.658448 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-cfbee806-c704-445f-bcac-0cd46e33b461 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 200 len: 14 microversion: 2.20 time: 0.103897 Nov 20 03:29:10.659390 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 420/763] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:29:10 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:11.670131 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-5bdb01de-8956-402a-92d1-57ff1c8391fb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:11.671112 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-5bdb01de-8956-402a-92d1-57ff1c8391fb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:11.677914 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5bdb01de-8956-402a-92d1-57ff1c8391fb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:11.678359 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5bdb01de-8956-402a-92d1-57ff1c8391fb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:11.679140 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5bdb01de-8956-402a-92d1-57ff1c8391fb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:11.679558 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5bdb01de-8956-402a-92d1-57ff1c8391fb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:11.773727 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-5bdb01de-8956-402a-92d1-57ff1c8391fb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 200 len: 14 microversion: 2.20 time: 0.107465 Nov 20 03:29:11.774765 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 344/764] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:29:11 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:12.786029 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-2fb99fe7-c2e9-455f-95c8-df489322ee2e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:12.787058 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-2fb99fe7-c2e9-455f-95c8-df489322ee2e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:12.794440 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2fb99fe7-c2e9-455f-95c8-df489322ee2e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:12.794900 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2fb99fe7-c2e9-455f-95c8-df489322ee2e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:12.795675 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2fb99fe7-c2e9-455f-95c8-df489322ee2e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:12.796307 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2fb99fe7-c2e9-455f-95c8-df489322ee2e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:12.883278 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-2fb99fe7-c2e9-455f-95c8-df489322ee2e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 200 len: 14 microversion: 2.20 time: 0.101151 Nov 20 03:29:12.884099 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 421/765] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:29:12 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:13.894986 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-2b5061f0-c12a-421d-9832-72828b619be8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:13.896227 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-2b5061f0-c12a-421d-9832-72828b619be8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:13.903100 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2b5061f0-c12a-421d-9832-72828b619be8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:13.903555 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2b5061f0-c12a-421d-9832-72828b619be8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:13.904381 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2b5061f0-c12a-421d-9832-72828b619be8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:13.904820 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2b5061f0-c12a-421d-9832-72828b619be8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:16.680826 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-2b5061f0-c12a-421d-9832-72828b619be8 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 200 len: 15025 microversion: 2.20 time: 2.789823 Nov 20 03:29:16.681770 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 345/766] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:29:13 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 15025 bytes in 2792 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:29:17.692703 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-1feb9436-bacd-495d-9cd4-8d4f23947ba6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:17.693629 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-1feb9436-bacd-495d-9cd4-8d4f23947ba6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:17.700571 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1feb9436-bacd-495d-9cd4-8d4f23947ba6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:17.701029 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1feb9436-bacd-495d-9cd4-8d4f23947ba6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:17.702151 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1feb9436-bacd-495d-9cd4-8d4f23947ba6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:17.702395 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1feb9436-bacd-495d-9cd4-8d4f23947ba6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:18.996412 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 03:29:18.996883 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: Sat Nov 20 03:29:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 03:29:19.901005 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-1feb9436-bacd-495d-9cd4-8d4f23947ba6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 200 len: 22070 microversion: 2.20 time: 2.212272 Nov 20 03:29:19.902502 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 422/767] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:29:17 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 22070 bytes in 2215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:29:20.913003 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-709aeb5a-4fff-4519-a0ef-7d5ba1e0868f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:20.914030 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-709aeb5a-4fff-4519-a0ef-7d5ba1e0868f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:20.921455 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-709aeb5a-4fff-4519-a0ef-7d5ba1e0868f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:20.921912 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-709aeb5a-4fff-4519-a0ef-7d5ba1e0868f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:20.922691 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-709aeb5a-4fff-4519-a0ef-7d5ba1e0868f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:20.923129 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-709aeb5a-4fff-4519-a0ef-7d5ba1e0868f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:23.044952 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-709aeb5a-4fff-4519-a0ef-7d5ba1e0868f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 200 len: 26515 microversion: 2.20 time: 2.135799 Nov 20 03:29:23.045726 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 346/768] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:29:20 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 26515 bytes in 2138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:29:24.057474 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-d8e8f2df-7fa5-4ac0-9d1d-5860d949cc02 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:24.058474 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-d8e8f2df-7fa5-4ac0-9d1d-5860d949cc02 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:24.065980 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d8e8f2df-7fa5-4ac0-9d1d-5860d949cc02 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:24.066440 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d8e8f2df-7fa5-4ac0-9d1d-5860d949cc02 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:24.067227 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d8e8f2df-7fa5-4ac0-9d1d-5860d949cc02 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:24.067673 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d8e8f2df-7fa5-4ac0-9d1d-5860d949cc02 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:26.051578 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-f3f3ac00-320e-46a2-a594-ead82b881208 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:26.052116 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-f3f3ac00-320e-46a2-a594-ead82b881208 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:26.059680 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f3f3ac00-320e-46a2-a594-ead82b881208 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:26.060166 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f3f3ac00-320e-46a2-a594-ead82b881208 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:26.060927 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f3f3ac00-320e-46a2-a594-ead82b881208 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:26.061355 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f3f3ac00-320e-46a2-a594-ead82b881208 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:26.083473 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.objects.instance [None req-f3f3ac00-320e-46a2-a594-ead82b881208 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lazy-loading 'flavor' on Instance uuid 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd {{(pid=116114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 03:29:26.152196 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-f3f3ac00-320e-46a2-a594-ead82b881208 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "POST /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd/action" status: 202 len: 0 microversion: 2.1 time: 0.104534 Nov 20 03:29:26.152959 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 347/769] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:29:26 2021] POST /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:29:26.160654 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-db3c81af-5b89-43b5-b160-2d6d44034fee tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:26.161333 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-db3c81af-5b89-43b5-b160-2d6d44034fee tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:26.167085 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-db3c81af-5b89-43b5-b160-2d6d44034fee tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:26.167527 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-db3c81af-5b89-43b5-b160-2d6d44034fee tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:26.168326 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-db3c81af-5b89-43b5-b160-2d6d44034fee tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:26.168753 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-db3c81af-5b89-43b5-b160-2d6d44034fee tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:26.175967 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-d8e8f2df-7fa5-4ac0-9d1d-5860d949cc02 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 200 len: 27785 microversion: 2.20 time: 2.122369 Nov 20 03:29:26.176641 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 423/770] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:29:24 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 27785 bytes in 2124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:29:26.478516 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-db3c81af-5b89-43b5-b160-2d6d44034fee tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:26.485824 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-db3c81af-5b89-43b5-b160-2d6d44034fee tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1568 microversion: 2.1 time: 0.328805 Nov 20 03:29:26.486394 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 348/771] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:26 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1568 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:29:27.295038 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-75305dde-3c0a-42ff-a501-e9e3fb6d5485 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:27.296122 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-75305dde-3c0a-42ff-a501-e9e3fb6d5485 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:27.302183 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-75305dde-3c0a-42ff-a501-e9e3fb6d5485 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:27.302629 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-75305dde-3c0a-42ff-a501-e9e3fb6d5485 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:27.303402 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-75305dde-3c0a-42ff-a501-e9e3fb6d5485 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:27.303864 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-75305dde-3c0a-42ff-a501-e9e3fb6d5485 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:27.503812 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-4a989ab4-0734-48e6-a4b1-eed53aac52e2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:27.504354 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-4a989ab4-0734-48e6-a4b1-eed53aac52e2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:27.511035 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4a989ab4-0734-48e6-a4b1-eed53aac52e2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:27.511489 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4a989ab4-0734-48e6-a4b1-eed53aac52e2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:27.512292 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4a989ab4-0734-48e6-a4b1-eed53aac52e2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:27.512727 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4a989ab4-0734-48e6-a4b1-eed53aac52e2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:27.643820 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-4a989ab4-0734-48e6-a4b1-eed53aac52e2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:27.651704 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-4a989ab4-0734-48e6-a4b1-eed53aac52e2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1568 microversion: 2.1 time: 0.151706 Nov 20 03:29:27.652303 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 349/772] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:27 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:29:28.669081 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-1e51e572-4adb-4b8c-8b1f-af6c381d44a4 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:28.669768 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-1e51e572-4adb-4b8c-8b1f-af6c381d44a4 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:28.676098 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1e51e572-4adb-4b8c-8b1f-af6c381d44a4 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:28.676554 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1e51e572-4adb-4b8c-8b1f-af6c381d44a4 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:28.677339 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1e51e572-4adb-4b8c-8b1f-af6c381d44a4 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:28.677779 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1e51e572-4adb-4b8c-8b1f-af6c381d44a4 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:28.806444 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-1e51e572-4adb-4b8c-8b1f-af6c381d44a4 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:28.813601 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-1e51e572-4adb-4b8c-8b1f-af6c381d44a4 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1568 microversion: 2.1 time: 0.148745 Nov 20 03:29:28.814154 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 350/773] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:28 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:29:29.346207 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-75305dde-3c0a-42ff-a501-e9e3fb6d5485 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 200 len: 27964 microversion: 2.20 time: 2.162230 Nov 20 03:29:29.347081 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 424/774] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:29:27 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 27964 bytes in 2164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:29:29.830893 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-653f4a42-da58-44f4-abc3-4822a4cb895d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:29.831509 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-653f4a42-da58-44f4-abc3-4822a4cb895d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:29.838032 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-653f4a42-da58-44f4-abc3-4822a4cb895d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:29.838482 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-653f4a42-da58-44f4-abc3-4822a4cb895d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:29.839262 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-653f4a42-da58-44f4-abc3-4822a4cb895d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:29.839696 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-653f4a42-da58-44f4-abc3-4822a4cb895d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:29.968414 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-653f4a42-da58-44f4-abc3-4822a4cb895d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:29.976511 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-653f4a42-da58-44f4-abc3-4822a4cb895d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1568 microversion: 2.1 time: 0.149141 Nov 20 03:29:29.977227 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 351/775] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:29 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:30.358545 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-7c134b9f-800c-41e3-b88f-1a0308f5e9ac tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:30.359528 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-7c134b9f-800c-41e3-b88f-1a0308f5e9ac tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:30.366391 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7c134b9f-800c-41e3-b88f-1a0308f5e9ac tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:30.366832 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7c134b9f-800c-41e3-b88f-1a0308f5e9ac tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:30.367601 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7c134b9f-800c-41e3-b88f-1a0308f5e9ac tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:30.368096 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7c134b9f-800c-41e3-b88f-1a0308f5e9ac tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:30.993953 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-50e41054-ef66-4b8c-ab3e-57f688686a93 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:30.994435 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-50e41054-ef66-4b8c-ab3e-57f688686a93 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:31.000564 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-50e41054-ef66-4b8c-ab3e-57f688686a93 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:31.001024 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-50e41054-ef66-4b8c-ab3e-57f688686a93 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:31.001822 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-50e41054-ef66-4b8c-ab3e-57f688686a93 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:31.002257 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-50e41054-ef66-4b8c-ab3e-57f688686a93 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:31.134410 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-50e41054-ef66-4b8c-ab3e-57f688686a93 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:31.141648 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-50e41054-ef66-4b8c-ab3e-57f688686a93 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1568 microversion: 2.1 time: 0.151547 Nov 20 03:29:31.142236 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 352/776] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:30 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:29:32.159331 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-a1b1b702-273c-4bf2-b958-f4d899023e02 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:32.159925 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-a1b1b702-273c-4bf2-b958-f4d899023e02 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:32.166768 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a1b1b702-273c-4bf2-b958-f4d899023e02 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:32.167215 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a1b1b702-273c-4bf2-b958-f4d899023e02 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:32.168022 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a1b1b702-273c-4bf2-b958-f4d899023e02 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:32.168458 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a1b1b702-273c-4bf2-b958-f4d899023e02 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:32.297852 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-a1b1b702-273c-4bf2-b958-f4d899023e02 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:32.305133 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-a1b1b702-273c-4bf2-b958-f4d899023e02 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1568 microversion: 2.1 time: 0.149474 Nov 20 03:29:32.305744 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 353/777] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:32 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:29:32.517537 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-7c134b9f-800c-41e3-b88f-1a0308f5e9ac tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 200 len: 28147 microversion: 2.20 time: 2.162784 Nov 20 03:29:32.519823 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 425/778] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:29:30 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 28147 bytes in 2164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:29:33.321033 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-07e02dba-a5bf-43b1-8b21-e2182fa57ed4 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:33.321654 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-07e02dba-a5bf-43b1-8b21-e2182fa57ed4 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:33.328205 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-07e02dba-a5bf-43b1-8b21-e2182fa57ed4 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:33.328661 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-07e02dba-a5bf-43b1-8b21-e2182fa57ed4 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:33.329450 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-07e02dba-a5bf-43b1-8b21-e2182fa57ed4 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:33.329888 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-07e02dba-a5bf-43b1-8b21-e2182fa57ed4 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:33.480864 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-07e02dba-a5bf-43b1-8b21-e2182fa57ed4 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:33.488297 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-07e02dba-a5bf-43b1-8b21-e2182fa57ed4 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1568 microversion: 2.1 time: 0.170814 Nov 20 03:29:33.489153 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 354/779] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:33 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:33.530857 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-a6a5865c-18c2-4324-b5d8-488cbb21089c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:33.532521 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-a6a5865c-18c2-4324-b5d8-488cbb21089c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:33.542975 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a6a5865c-18c2-4324-b5d8-488cbb21089c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:33.543475 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a6a5865c-18c2-4324-b5d8-488cbb21089c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:33.544898 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a6a5865c-18c2-4324-b5d8-488cbb21089c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:33.545511 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a6a5865c-18c2-4324-b5d8-488cbb21089c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:33.642523 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-a6a5865c-18c2-4324-b5d8-488cbb21089c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 200 len: 28147 microversion: 2.20 time: 0.116553 Nov 20 03:29:33.644132 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 426/780] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:29:33 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 28147 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:29:34.505723 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-ba0ce9ef-4525-401d-a5e5-e407bdcc79b6 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:34.506335 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-ba0ce9ef-4525-401d-a5e5-e407bdcc79b6 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:34.513152 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ba0ce9ef-4525-401d-a5e5-e407bdcc79b6 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:34.513600 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ba0ce9ef-4525-401d-a5e5-e407bdcc79b6 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:34.514368 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ba0ce9ef-4525-401d-a5e5-e407bdcc79b6 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:34.514802 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ba0ce9ef-4525-401d-a5e5-e407bdcc79b6 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:34.646327 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-ba0ce9ef-4525-401d-a5e5-e407bdcc79b6 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:34.654675 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-ba0ce9ef-4525-401d-a5e5-e407bdcc79b6 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1568 microversion: 2.1 time: 0.152514 Nov 20 03:29:34.655034 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-f3ac6c07-acec-4f34-8742-9cd2238d5525 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:34.656848 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f3ac6c07-acec-4f34-8742-9cd2238d5525 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:34.663621 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f3ac6c07-acec-4f34-8742-9cd2238d5525 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:34.664202 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 355/781] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:34 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:34.664347 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f3ac6c07-acec-4f34-8742-9cd2238d5525 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:34.665143 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f3ac6c07-acec-4f34-8742-9cd2238d5525 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:34.665577 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f3ac6c07-acec-4f34-8742-9cd2238d5525 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:34.771122 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-f3ac6c07-acec-4f34-8742-9cd2238d5525 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 200 len: 28388 microversion: 2.20 time: 0.120181 Nov 20 03:29:34.775514 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 427/782] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:29:34 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 28388 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 03:29:35.671079 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-09109bc6-cc69-4ed3-a930-5681c50ab00e tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:35.671692 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-09109bc6-cc69-4ed3-a930-5681c50ab00e tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:35.677675 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-09109bc6-cc69-4ed3-a930-5681c50ab00e tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:35.678123 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-09109bc6-cc69-4ed3-a930-5681c50ab00e tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:35.679168 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-09109bc6-cc69-4ed3-a930-5681c50ab00e tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:35.679611 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-09109bc6-cc69-4ed3-a930-5681c50ab00e tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:35.684852 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-de22355c-6c39-4408-aabf-66853ba49a2e tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:35.685426 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-de22355c-6c39-4408-aabf-66853ba49a2e tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: d8c73da7-1d03-4af8-9786-356bb0e48249] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:35.692079 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-de22355c-6c39-4408-aabf-66853ba49a2e tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:35.692524 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-de22355c-6c39-4408-aabf-66853ba49a2e tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:35.693295 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-de22355c-6c39-4408-aabf-66853ba49a2e tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:35.693725 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-de22355c-6c39-4408-aabf-66853ba49a2e tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:35.812049 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-09109bc6-cc69-4ed3-a930-5681c50ab00e tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:35.819441 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-09109bc6-cc69-4ed3-a930-5681c50ab00e tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1568 microversion: 2.1 time: 0.151858 Nov 20 03:29:35.820026 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 356/783] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:35 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:35.825202 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-d728b187-8784-4877-a6df-e52decf80606 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:35.826606 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-d728b187-8784-4877-a6df-e52decf80606 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:35.827435 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.objects.instance [None req-de22355c-6c39-4408-aabf-66853ba49a2e tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lazy-loading 'services' on Instance uuid d8c73da7-1d03-4af8-9786-356bb0e48249 {{(pid=116113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 03:29:35.832932 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d728b187-8784-4877-a6df-e52decf80606 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:35.833511 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d728b187-8784-4877-a6df-e52decf80606 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:35.834296 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d728b187-8784-4877-a6df-e52decf80606 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:35.834725 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d728b187-8784-4877-a6df-e52decf80606 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:35.904488 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-de22355c-6c39-4408-aabf-66853ba49a2e tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "DELETE /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249/os-volume_attachments/d53055e0-e6b4-4785-b25d-eb27e93d08d7" status: 202 len: 0 microversion: 2.1 time: 0.223990 Nov 20 03:29:35.905094 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 428/784] 10.222.0.37 () {58 vars in 1415 bytes} [Sat Nov 20 03:29:35 2021] DELETE /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249/os-volume_attachments/d53055e0-e6b4-4785-b25d-eb27e93d08d7 => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 03:29:35.936483 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-d728b187-8784-4877-a6df-e52decf80606 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 200 len: 28437 microversion: 2.20 time: 0.115195 Nov 20 03:29:35.937132 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 357/785] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:29:35 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 28437 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:29:36.837584 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ba1c9a0b-8e60-4639-b8fa-21d48d2760fe tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:36.838258 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ba1c9a0b-8e60-4639-b8fa-21d48d2760fe tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:36.846292 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ba1c9a0b-8e60-4639-b8fa-21d48d2760fe tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:36.847022 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ba1c9a0b-8e60-4639-b8fa-21d48d2760fe tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:36.848047 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ba1c9a0b-8e60-4639-b8fa-21d48d2760fe tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:36.848474 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ba1c9a0b-8e60-4639-b8fa-21d48d2760fe tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:36.948799 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-dea26774-a779-4925-9abc-c23af298ac18 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:36.949807 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-dea26774-a779-4925-9abc-c23af298ac18 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:36.957603 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dea26774-a779-4925-9abc-c23af298ac18 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:36.958060 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dea26774-a779-4925-9abc-c23af298ac18 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:36.958855 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dea26774-a779-4925-9abc-c23af298ac18 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:36.959311 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dea26774-a779-4925-9abc-c23af298ac18 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:36.998095 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-ba1c9a0b-8e60-4639-b8fa-21d48d2760fe tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:37.005677 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ba1c9a0b-8e60-4639-b8fa-21d48d2760fe tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1568 microversion: 2.1 time: 0.172541 Nov 20 03:29:37.006722 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 429/786] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:36 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:37.038282 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-660f6980-007b-464a-b8af-e79fdc1949b9 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:37.038805 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-660f6980-007b-464a-b8af-e79fdc1949b9 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: d8c73da7-1d03-4af8-9786-356bb0e48249] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:37.045322 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-660f6980-007b-464a-b8af-e79fdc1949b9 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:37.045780 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-660f6980-007b-464a-b8af-e79fdc1949b9 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:37.046653 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-660f6980-007b-464a-b8af-e79fdc1949b9 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:37.047094 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-660f6980-007b-464a-b8af-e79fdc1949b9 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:37.072440 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-660f6980-007b-464a-b8af-e79fdc1949b9 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: d8c73da7-1d03-4af8-9786-356bb0e48249] Going to try to terminate instance {{(pid=116113) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 03:29:37.072665 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-dea26774-a779-4925-9abc-c23af298ac18 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 200 len: 28605 microversion: 2.20 time: 0.127825 Nov 20 03:29:37.075818 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 358/787] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:29:36 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 28605 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 03:29:37.144377 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-660f6980-007b-464a-b8af-e79fdc1949b9 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "DELETE /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249" status: 204 len: 0 microversion: 2.1 time: 0.109510 Nov 20 03:29:37.144966 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 430/788] 10.222.0.37 () {58 vars in 1238 bytes} [Sat Nov 20 03:29:37 2021] DELETE /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 03:29:37.154923 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-a1be0ae7-e903-41d1-ae5d-9563bfdcb21e tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:37.155624 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-a1be0ae7-e903-41d1-ae5d-9563bfdcb21e tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: d8c73da7-1d03-4af8-9786-356bb0e48249] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:37.162531 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a1be0ae7-e903-41d1-ae5d-9563bfdcb21e tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:37.162980 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a1be0ae7-e903-41d1-ae5d-9563bfdcb21e tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:37.163757 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a1be0ae7-e903-41d1-ae5d-9563bfdcb21e tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:37.164218 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a1be0ae7-e903-41d1-ae5d-9563bfdcb21e tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:37.293931 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-a1be0ae7-e903-41d1-ae5d-9563bfdcb21e tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:37.301622 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-a1be0ae7-e903-41d1-ae5d-9563bfdcb21e tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249" status: 200 len: 1512 microversion: 2.1 time: 0.150755 Nov 20 03:29:37.302184 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 359/789] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:37 2021] GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:38.023361 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-e724f1a1-02c0-426e-835e-ac2c738ca27b tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:38.024086 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-e724f1a1-02c0-426e-835e-ac2c738ca27b tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:38.030303 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e724f1a1-02c0-426e-835e-ac2c738ca27b tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:38.030751 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e724f1a1-02c0-426e-835e-ac2c738ca27b tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:38.031521 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e724f1a1-02c0-426e-835e-ac2c738ca27b tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:38.031989 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e724f1a1-02c0-426e-835e-ac2c738ca27b tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:38.084112 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-0c35bb2a-f427-4598-a8e0-b9a52d8fd7e2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:38.085320 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-0c35bb2a-f427-4598-a8e0-b9a52d8fd7e2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:38.091893 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0c35bb2a-f427-4598-a8e0-b9a52d8fd7e2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:38.092438 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0c35bb2a-f427-4598-a8e0-b9a52d8fd7e2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:38.093310 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0c35bb2a-f427-4598-a8e0-b9a52d8fd7e2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:38.093825 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0c35bb2a-f427-4598-a8e0-b9a52d8fd7e2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:38.171642 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-e724f1a1-02c0-426e-835e-ac2c738ca27b tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:38.179774 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-e724f1a1-02c0-426e-835e-ac2c738ca27b tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1568 microversion: 2.1 time: 0.160403 Nov 20 03:29:38.180710 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 431/790] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:38 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:38.184732 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-0c35bb2a-f427-4598-a8e0-b9a52d8fd7e2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 200 len: 28605 microversion: 2.20 time: 0.104046 Nov 20 03:29:38.185935 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 360/791] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:29:38 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 28605 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 03:29:38.318919 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-e2f170c9-66db-40a7-878c-5427425fad28 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:38.319526 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-e2f170c9-66db-40a7-878c-5427425fad28 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: d8c73da7-1d03-4af8-9786-356bb0e48249] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:38.325377 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e2f170c9-66db-40a7-878c-5427425fad28 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:38.325822 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e2f170c9-66db-40a7-878c-5427425fad28 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:38.326592 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e2f170c9-66db-40a7-878c-5427425fad28 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:38.327021 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e2f170c9-66db-40a7-878c-5427425fad28 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:38.458390 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-e2f170c9-66db-40a7-878c-5427425fad28 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:38.466925 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-e2f170c9-66db-40a7-878c-5427425fad28 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249" status: 200 len: 1512 microversion: 2.1 time: 0.151560 Nov 20 03:29:38.467531 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 432/792] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:38 2021] GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:39.203255 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-67735306-bd62-4e67-a721-b5eec353c45e tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:39.203742 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-67735306-bd62-4e67-a721-b5eec353c45e tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:39.205848 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-6d905fd8-c5e9-45a7-a1d7-36462c89c219 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:39.207649 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-6d905fd8-c5e9-45a7-a1d7-36462c89c219 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:39.217391 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-67735306-bd62-4e67-a721-b5eec353c45e tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:39.219616 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-67735306-bd62-4e67-a721-b5eec353c45e tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:39.223568 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-67735306-bd62-4e67-a721-b5eec353c45e tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:39.224039 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-67735306-bd62-4e67-a721-b5eec353c45e tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:39.225781 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6d905fd8-c5e9-45a7-a1d7-36462c89c219 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:39.226230 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6d905fd8-c5e9-45a7-a1d7-36462c89c219 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:39.227024 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6d905fd8-c5e9-45a7-a1d7-36462c89c219 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:39.227466 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6d905fd8-c5e9-45a7-a1d7-36462c89c219 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:39.333913 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-6d905fd8-c5e9-45a7-a1d7-36462c89c219 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 200 len: 28605 microversion: 2.20 time: 0.140485 Nov 20 03:29:39.334776 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 361/793] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:29:39 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 28605 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:29:39.439073 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-67735306-bd62-4e67-a721-b5eec353c45e tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:39.448894 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-67735306-bd62-4e67-a721-b5eec353c45e tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1568 microversion: 2.1 time: 0.252237 Nov 20 03:29:39.460086 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 433/794] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:39 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1568 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:39.485147 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-8ca29609-ee12-4b4d-8875-9870dbe1325d tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:39.485851 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-8ca29609-ee12-4b4d-8875-9870dbe1325d tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: d8c73da7-1d03-4af8-9786-356bb0e48249] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:39.492688 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8ca29609-ee12-4b4d-8875-9870dbe1325d tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:39.493978 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8ca29609-ee12-4b4d-8875-9870dbe1325d tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:39.494774 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8ca29609-ee12-4b4d-8875-9870dbe1325d tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:39.495380 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8ca29609-ee12-4b4d-8875-9870dbe1325d tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:39.699211 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-8ca29609-ee12-4b4d-8875-9870dbe1325d tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:39.709474 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-8ca29609-ee12-4b4d-8875-9870dbe1325d tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249" status: 200 len: 1512 microversion: 2.1 time: 0.228252 Nov 20 03:29:39.721997 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 362/795] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:39 2021] GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249 => generated 1512 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:39.975310 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-d9d37cb0-a054-45fe-85db-de770e438b15 req-8729c64a-2bbc-4b9b-8478-91e97cee2c64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8c73da7-1d03-4af8-9786-356bb0e48249", "name": "network-vif-deleted", "tag": "42866751-7c05-4c8c-97b5-ffc492d2081d"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:39.976919 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:29:39.976919 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:29:39.985207 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-d9d37cb0-a054-45fe-85db-de770e438b15 req-8729c64a-2bbc-4b9b-8478-91e97cee2c64 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:39.985888 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-d9d37cb0-a054-45fe-85db-de770e438b15 req-8729c64a-2bbc-4b9b-8478-91e97cee2c64 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:39.996908 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-d9d37cb0-a054-45fe-85db-de770e438b15 req-8729c64a-2bbc-4b9b-8478-91e97cee2c64 service nova] Creating event network-vif-deleted:42866751-7c05-4c8c-97b5-ffc492d2081d for instance d8c73da7-1d03-4af8-9786-356bb0e48249 on hv-cinder-81803 Nov 20 03:29:40.001550 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-d9d37cb0-a054-45fe-85db-de770e438b15 req-8729c64a-2bbc-4b9b-8478-91e97cee2c64 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163028 Nov 20 03:29:40.002191 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 434/796] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:29:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:29:40.346086 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-5352a0f3-b4e3-489e-a6d6-7155405147c9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:40.347345 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-5352a0f3-b4e3-489e-a6d6-7155405147c9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:40.357994 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5352a0f3-b4e3-489e-a6d6-7155405147c9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:40.362832 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5352a0f3-b4e3-489e-a6d6-7155405147c9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:40.363675 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5352a0f3-b4e3-489e-a6d6-7155405147c9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:40.364150 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5352a0f3-b4e3-489e-a6d6-7155405147c9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:40.467533 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-959eb5d7-e684-4103-9819-af88975519bb tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:40.468892 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-959eb5d7-e684-4103-9819-af88975519bb tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:40.475478 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-959eb5d7-e684-4103-9819-af88975519bb tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:40.476213 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-959eb5d7-e684-4103-9819-af88975519bb tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:40.477220 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-959eb5d7-e684-4103-9819-af88975519bb tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:40.477862 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-959eb5d7-e684-4103-9819-af88975519bb tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:40.478283 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-5352a0f3-b4e3-489e-a6d6-7155405147c9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 200 len: 28879 microversion: 2.20 time: 0.135593 Nov 20 03:29:40.482215 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 363/797] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:29:40 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 28879 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:29:40.631008 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-959eb5d7-e684-4103-9819-af88975519bb tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:40.639466 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-959eb5d7-e684-4103-9819-af88975519bb tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1568 microversion: 2.1 time: 0.176267 Nov 20 03:29:40.640349 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 435/798] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:40 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:29:40.729323 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-10686cb7-58b6-4527-92f6-a9c80fdfdda1 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:40.730107 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-10686cb7-58b6-4527-92f6-a9c80fdfdda1 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: d8c73da7-1d03-4af8-9786-356bb0e48249] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:40.737583 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-10686cb7-58b6-4527-92f6-a9c80fdfdda1 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:40.738168 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-10686cb7-58b6-4527-92f6-a9c80fdfdda1 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:40.739109 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-10686cb7-58b6-4527-92f6-a9c80fdfdda1 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:40.739662 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-10686cb7-58b6-4527-92f6-a9c80fdfdda1 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:40.755346 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.wsgi [None req-10686cb7-58b6-4527-92f6-a9c80fdfdda1 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] HTTP exception thrown: Instance d8c73da7-1d03-4af8-9786-356bb0e48249 could not be found. Nov 20 03:29:40.756207 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-10686cb7-58b6-4527-92f6-a9c80fdfdda1 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Returning 404 to user: Instance d8c73da7-1d03-4af8-9786-356bb0e48249 could not be found. {{(pid=116114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:29:40.757275 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-10686cb7-58b6-4527-92f6-a9c80fdfdda1 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249" status: 404 len: 111 microversion: 2.1 time: 0.032232 Nov 20 03:29:40.757914 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 364/799] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:40 2021] GET /compute/v2.1/servers/d8c73da7-1d03-4af8-9786-356bb0e48249 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:29:41.489948 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-08f83f26-b9b6-4989-a73d-0fdac9874a43 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:41.490873 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-08f83f26-b9b6-4989-a73d-0fdac9874a43 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:41.497330 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-08f83f26-b9b6-4989-a73d-0fdac9874a43 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:41.497791 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-08f83f26-b9b6-4989-a73d-0fdac9874a43 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:41.498587 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-08f83f26-b9b6-4989-a73d-0fdac9874a43 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:41.499035 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-08f83f26-b9b6-4989-a73d-0fdac9874a43 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:41.657997 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-cf7b2af5-9a04-48ae-8d38-e20622f35a9b tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:41.658719 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-cf7b2af5-9a04-48ae-8d38-e20622f35a9b tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:41.665565 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cf7b2af5-9a04-48ae-8d38-e20622f35a9b tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:41.666105 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cf7b2af5-9a04-48ae-8d38-e20622f35a9b tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:41.666991 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cf7b2af5-9a04-48ae-8d38-e20622f35a9b tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:41.667643 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cf7b2af5-9a04-48ae-8d38-e20622f35a9b tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:41.809885 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-cf7b2af5-9a04-48ae-8d38-e20622f35a9b tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:41.817554 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-cf7b2af5-9a04-48ae-8d38-e20622f35a9b tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1568 microversion: 2.1 time: 0.163602 Nov 20 03:29:41.818220 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 365/800] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:41 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:42.834378 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-b8c50f8b-7b1b-4027-bad3-97179e1ba7b7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:42.835871 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-b8c50f8b-7b1b-4027-bad3-97179e1ba7b7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:42.844522 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b8c50f8b-7b1b-4027-bad3-97179e1ba7b7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:42.846809 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b8c50f8b-7b1b-4027-bad3-97179e1ba7b7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:42.847879 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b8c50f8b-7b1b-4027-bad3-97179e1ba7b7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:42.848555 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b8c50f8b-7b1b-4027-bad3-97179e1ba7b7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:43.068497 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-b8c50f8b-7b1b-4027-bad3-97179e1ba7b7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:43.079102 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-b8c50f8b-7b1b-4027-bad3-97179e1ba7b7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1568 microversion: 2.1 time: 0.248212 Nov 20 03:29:43.082195 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 366/801] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:42 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1568 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:43.947227 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-08f83f26-b9b6-4989-a73d-0fdac9874a43 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 200 len: 34116 microversion: 2.20 time: 2.460813 Nov 20 03:29:43.948618 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 436/802] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:29:41 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 34116 bytes in 2463 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:29:44.099114 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-6c2ab543-d9af-4fe5-9cd9-446702126250 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:44.100486 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-6c2ab543-d9af-4fe5-9cd9-446702126250 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:44.107283 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6c2ab543-d9af-4fe5-9cd9-446702126250 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:44.108089 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6c2ab543-d9af-4fe5-9cd9-446702126250 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:44.109392 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6c2ab543-d9af-4fe5-9cd9-446702126250 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:44.110177 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6c2ab543-d9af-4fe5-9cd9-446702126250 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:44.525695 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-6c2ab543-d9af-4fe5-9cd9-446702126250 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:44.534050 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-6c2ab543-d9af-4fe5-9cd9-446702126250 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1568 microversion: 2.1 time: 0.439251 Nov 20 03:29:44.534625 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 367/803] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:44 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1568 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:44.960549 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-f997fb2e-7b1a-4ed6-a3fd-637bc78283d0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:44.961822 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f997fb2e-7b1a-4ed6-a3fd-637bc78283d0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:44.968520 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f997fb2e-7b1a-4ed6-a3fd-637bc78283d0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:44.968972 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f997fb2e-7b1a-4ed6-a3fd-637bc78283d0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:44.970117 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f997fb2e-7b1a-4ed6-a3fd-637bc78283d0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:44.970559 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f997fb2e-7b1a-4ed6-a3fd-637bc78283d0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:45.079693 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-f997fb2e-7b1a-4ed6-a3fd-637bc78283d0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 200 len: 35090 microversion: 2.20 time: 0.122769 Nov 20 03:29:45.081049 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 437/804] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:29:44 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 35090 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 03:29:45.552806 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-c210aaeb-47a9-465e-bfb2-39b041c5531d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:45.553685 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-c210aaeb-47a9-465e-bfb2-39b041c5531d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:45.563499 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c210aaeb-47a9-465e-bfb2-39b041c5531d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:45.564282 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c210aaeb-47a9-465e-bfb2-39b041c5531d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:45.565177 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c210aaeb-47a9-465e-bfb2-39b041c5531d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:45.565850 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c210aaeb-47a9-465e-bfb2-39b041c5531d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:45.737475 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-c210aaeb-47a9-465e-bfb2-39b041c5531d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:45.745678 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-c210aaeb-47a9-465e-bfb2-39b041c5531d tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1568 microversion: 2.1 time: 0.197302 Nov 20 03:29:45.755332 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 368/805] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:45 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:46.093024 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-66e6deb9-d4fe-42cc-9adb-e06b6c3392b0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:46.094062 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-66e6deb9-d4fe-42cc-9adb-e06b6c3392b0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:46.101457 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-66e6deb9-d4fe-42cc-9adb-e06b6c3392b0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:46.102036 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-66e6deb9-d4fe-42cc-9adb-e06b6c3392b0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:46.103482 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-66e6deb9-d4fe-42cc-9adb-e06b6c3392b0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:46.104566 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-66e6deb9-d4fe-42cc-9adb-e06b6c3392b0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:46.772586 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-95e59c85-856d-4950-b805-c89bc4bd77e2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:46.774720 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-95e59c85-856d-4950-b805-c89bc4bd77e2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:46.783537 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-95e59c85-856d-4950-b805-c89bc4bd77e2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:46.788510 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-95e59c85-856d-4950-b805-c89bc4bd77e2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:46.790559 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-95e59c85-856d-4950-b805-c89bc4bd77e2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:46.792465 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-95e59c85-856d-4950-b805-c89bc4bd77e2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:47.069330 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-95e59c85-856d-4950-b805-c89bc4bd77e2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:47.081042 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-95e59c85-856d-4950-b805-c89bc4bd77e2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1568 microversion: 2.1 time: 0.319654 Nov 20 03:29:47.094431 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 369/806] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:46 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1568 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:29:48.104017 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-e940450b-3753-4d6b-96fb-706f6f1d9fcb tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:48.105421 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-e940450b-3753-4d6b-96fb-706f6f1d9fcb tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:48.114698 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e940450b-3753-4d6b-96fb-706f6f1d9fcb tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:48.117671 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e940450b-3753-4d6b-96fb-706f6f1d9fcb tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:48.118820 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e940450b-3753-4d6b-96fb-706f6f1d9fcb tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:48.121578 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e940450b-3753-4d6b-96fb-706f6f1d9fcb tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:48.457582 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-e940450b-3753-4d6b-96fb-706f6f1d9fcb tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:48.466283 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-e940450b-3753-4d6b-96fb-706f6f1d9fcb tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1568 microversion: 2.1 time: 0.366745 Nov 20 03:29:48.467137 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 370/807] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:48 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1568 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:48.498899 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-66e6deb9-d4fe-42cc-9adb-e06b6c3392b0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 200 len: 38090 microversion: 2.20 time: 2.410014 Nov 20 03:29:48.500300 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 438/808] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:29:46 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 38090 bytes in 2413 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 03:29:48.716066 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-cb30f240-25f0-4b77-8804-6c938508c2df tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1228504692", "imageRef": "e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0", "flavorRef": "452", "networks": [{"uuid": "86b72eeb-91ec-4820-a22e-ae047328594a"}]}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:48.771676 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.network.neutron [None req-cb30f240-25f0-4b77-8804-6c938508c2df tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] validate_networks() for [('86b72eeb-91ec-4820-a22e-ae047328594a', None, None, None, None, None)] {{(pid=116114) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 03:29:49.489361 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-c6f87705-91d4-4154-bb59-9d14bd71ed52 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:49.490978 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-c6f87705-91d4-4154-bb59-9d14bd71ed52 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:49.502427 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c6f87705-91d4-4154-bb59-9d14bd71ed52 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:49.503757 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c6f87705-91d4-4154-bb59-9d14bd71ed52 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:49.504731 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c6f87705-91d4-4154-bb59-9d14bd71ed52 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:49.507598 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c6f87705-91d4-4154-bb59-9d14bd71ed52 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:49.800434 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-c6f87705-91d4-4154-bb59-9d14bd71ed52 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:49.816899 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-c6f87705-91d4-4154-bb59-9d14bd71ed52 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1568 microversion: 2.1 time: 0.333560 Nov 20 03:29:49.817485 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 439/809] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:49 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1568 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:49.822317 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-b2424892-76c7-45f7-997b-809c151079d9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:49.823704 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-b2424892-76c7-45f7-997b-809c151079d9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:49.831233 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b2424892-76c7-45f7-997b-809c151079d9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:49.832331 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b2424892-76c7-45f7-997b-809c151079d9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:49.833634 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b2424892-76c7-45f7-997b-809c151079d9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:49.834240 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b2424892-76c7-45f7-997b-809c151079d9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:49.834382 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-cb30f240-25f0-4b77-8804-6c938508c2df tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Flavor limits 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 03:29:49.835513 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-cb30f240-25f0-4b77-8804-6c938508c2df tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Image limits 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 03:29:49.836092 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-cb30f240-25f0-4b77-8804-6c938508c2df tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Flavor pref 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 03:29:49.837966 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-cb30f240-25f0-4b77-8804-6c938508c2df tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Image pref 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 03:29:49.838601 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-cb30f240-25f0-4b77-8804-6c938508c2df tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 03:29:49.850125 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cb30f240-25f0-4b77-8804-6c938508c2df tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:49.850820 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cb30f240-25f0-4b77-8804-6c938508c2df tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:49.851848 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cb30f240-25f0-4b77-8804-6c938508c2df tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:49.852812 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cb30f240-25f0-4b77-8804-6c938508c2df tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:49.871935 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-cb30f240-25f0-4b77-8804-6c938508c2df tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Getting quotas for project fe445c6e096a48fc860957cb4adc25b2. Resources: {'ram', 'cores', 'instances'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:29:49.876612 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-cb30f240-25f0-4b77-8804-6c938508c2df tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Getting quotas for user d6bb4c48a413496c985d201933aad911 and project fe445c6e096a48fc860957cb4adc25b2. Resources: {'ram', 'cores', 'instances'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:29:49.888485 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-cb30f240-25f0-4b77-8804-6c938508c2df tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Going to run 1 instances... {{(pid=116114) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 03:29:49.891254 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-cb30f240-25f0-4b77-8804-6c938508c2df tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: 51fdb082-29f4-42ab-96d3-86dcfd59910c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 03:29:49.950006 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-b2424892-76c7-45f7-997b-809c151079d9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 200 len: 38159 microversion: 2.20 time: 0.131065 Nov 20 03:29:49.954186 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 440/810] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:29:49 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 38159 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:29:49.956734 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-cb30f240-25f0-4b77-8804-6c938508c2df tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.244248 Nov 20 03:29:49.957613 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 371/811] 10.222.0.37 () {60 vars in 1146 bytes} [Sat Nov 20 03:29:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 1246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 03:29:49.968849 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-e57be55d-1ae7-49e8-90ce-d7fa37d1fdd7 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:49.969568 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-e57be55d-1ae7-49e8-90ce-d7fa37d1fdd7 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: 51fdb082-29f4-42ab-96d3-86dcfd59910c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:50.034493 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-e57be55d-1ae7-49e8-90ce-d7fa37d1fdd7 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:50.043859 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-e57be55d-1ae7-49e8-90ce-d7fa37d1fdd7 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c" status: 200 len: 1219 microversion: 2.1 time: 0.079294 Nov 20 03:29:50.045204 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 441/812] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:49 2021] GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:50.835033 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-40366f5e-a05a-4594-ab50-e139b7fe1574 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:50.835969 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-40366f5e-a05a-4594-ab50-e139b7fe1574 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:50.843512 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-40366f5e-a05a-4594-ab50-e139b7fe1574 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:50.844016 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-40366f5e-a05a-4594-ab50-e139b7fe1574 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:50.844809 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-40366f5e-a05a-4594-ab50-e139b7fe1574 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:50.845305 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-40366f5e-a05a-4594-ab50-e139b7fe1574 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:50.961500 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-60797cb5-bdeb-47de-b0cc-94867f387547 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:50.962623 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-60797cb5-bdeb-47de-b0cc-94867f387547 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:50.976416 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-60797cb5-bdeb-47de-b0cc-94867f387547 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:50.978714 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-60797cb5-bdeb-47de-b0cc-94867f387547 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:50.979568 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-60797cb5-bdeb-47de-b0cc-94867f387547 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:50.980050 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-60797cb5-bdeb-47de-b0cc-94867f387547 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:51.069235 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-40366f5e-a05a-4594-ab50-e139b7fe1574 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:51.078892 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-40366f5e-a05a-4594-ab50-e139b7fe1574 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1509 microversion: 2.1 time: 0.248852 Nov 20 03:29:51.090342 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 372/813] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:50 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1509 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:51.094222 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-57ee6795-6a11-41ba-82ea-7daebe1b8565 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:51.094877 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-57ee6795-6a11-41ba-82ea-7daebe1b8565 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: 51fdb082-29f4-42ab-96d3-86dcfd59910c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:51.096867 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-60797cb5-bdeb-47de-b0cc-94867f387547 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 200 len: 38159 microversion: 2.20 time: 0.138848 Nov 20 03:29:51.098083 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 442/814] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:29:50 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 38159 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 03:29:51.103374 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-8e418988-c3da-4978-b250-fe7b693cbc3f tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:51.104192 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-57ee6795-6a11-41ba-82ea-7daebe1b8565 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:51.104641 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-57ee6795-6a11-41ba-82ea-7daebe1b8565 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:51.105033 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-8e418988-c3da-4978-b250-fe7b693cbc3f tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:51.105426 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-57ee6795-6a11-41ba-82ea-7daebe1b8565 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:51.106035 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-57ee6795-6a11-41ba-82ea-7daebe1b8565 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:51.116809 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8e418988-c3da-4978-b250-fe7b693cbc3f tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:51.117257 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8e418988-c3da-4978-b250-fe7b693cbc3f tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:51.118578 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8e418988-c3da-4978-b250-fe7b693cbc3f tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:51.119015 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8e418988-c3da-4978-b250-fe7b693cbc3f tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:51.190039 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-57ee6795-6a11-41ba-82ea-7daebe1b8565 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:51.198164 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-57ee6795-6a11-41ba-82ea-7daebe1b8565 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c" status: 200 len: 1271 microversion: 2.1 time: 0.115378 Nov 20 03:29:51.198734 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 373/815] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:51 2021] GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c => generated 1271 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:51.373326 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-8e418988-c3da-4978-b250-fe7b693cbc3f tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "POST /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd/action" status: 202 len: 0 microversion: 2.1 time: 0.274493 Nov 20 03:29:51.378109 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 443/816] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:29:51 2021] POST /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:29:51.382539 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-6e00658d-b2bc-4d99-a978-8bd14a61fdde tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:51.383159 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-6e00658d-b2bc-4d99-a978-8bd14a61fdde tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:51.391303 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6e00658d-b2bc-4d99-a978-8bd14a61fdde tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:51.396569 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6e00658d-b2bc-4d99-a978-8bd14a61fdde tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:51.397410 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6e00658d-b2bc-4d99-a978-8bd14a61fdde tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:51.397849 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6e00658d-b2bc-4d99-a978-8bd14a61fdde tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:51.678121 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-6e00658d-b2bc-4d99-a978-8bd14a61fdde tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:51.685780 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-6e00658d-b2bc-4d99-a978-8bd14a61fdde tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1517 microversion: 2.1 time: 0.306743 Nov 20 03:29:51.693213 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 374/817] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:51 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1517 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:29:52.110552 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-731aeb32-02f0-4c57-8294-b0dd13ec4fc2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:52.111634 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-731aeb32-02f0-4c57-8294-b0dd13ec4fc2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:52.126154 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-731aeb32-02f0-4c57-8294-b0dd13ec4fc2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:52.126880 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-731aeb32-02f0-4c57-8294-b0dd13ec4fc2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:52.127852 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-731aeb32-02f0-4c57-8294-b0dd13ec4fc2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:52.128467 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-731aeb32-02f0-4c57-8294-b0dd13ec4fc2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:52.217996 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-2b0b0522-8a01-4550-be2f-69454243f246 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:52.219648 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-2b0b0522-8a01-4550-be2f-69454243f246 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: 51fdb082-29f4-42ab-96d3-86dcfd59910c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:52.235266 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2b0b0522-8a01-4550-be2f-69454243f246 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:52.235987 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2b0b0522-8a01-4550-be2f-69454243f246 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:52.238034 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2b0b0522-8a01-4550-be2f-69454243f246 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:52.238591 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2b0b0522-8a01-4550-be2f-69454243f246 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:52.266816 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-731aeb32-02f0-4c57-8294-b0dd13ec4fc2 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 200 len: 38300 microversion: 2.20 time: 0.160658 Nov 20 03:29:52.275989 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 444/818] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:29:52 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 38300 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:29:52.290139 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-c519cd12-0f5f-47ab-a371-67e8d23236ab tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:52.290845 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-c519cd12-0f5f-47ab-a371-67e8d23236ab tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:52.298070 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c519cd12-0f5f-47ab-a371-67e8d23236ab tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:52.298539 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c519cd12-0f5f-47ab-a371-67e8d23236ab tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:52.299320 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c519cd12-0f5f-47ab-a371-67e8d23236ab tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:52.299750 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c519cd12-0f5f-47ab-a371-67e8d23236ab tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:52.328927 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-c519cd12-0f5f-47ab-a371-67e8d23236ab tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/ips" status: 200 len: 151 microversion: 2.20 time: 0.048250 Nov 20 03:29:52.333753 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 445/819] 10.222.0.37 () {60 vars in 1288 bytes} [Sat Nov 20 03:29:52 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/ips => generated 151 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:29:52.364770 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-2b0b0522-8a01-4550-be2f-69454243f246 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:52.374015 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-2b0b0522-8a01-4550-be2f-69454243f246 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c" status: 200 len: 1277 microversion: 2.1 time: 0.162592 Nov 20 03:29:52.376486 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 375/820] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:52 2021] GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:52.703809 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-4f0ab13b-b662-4874-80cb-e1e32769bdb0 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:52.704881 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-4f0ab13b-b662-4874-80cb-e1e32769bdb0 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:52.717786 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4f0ab13b-b662-4874-80cb-e1e32769bdb0 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:52.720453 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4f0ab13b-b662-4874-80cb-e1e32769bdb0 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:52.722090 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4f0ab13b-b662-4874-80cb-e1e32769bdb0 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:52.724878 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4f0ab13b-b662-4874-80cb-e1e32769bdb0 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:53.316990 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-4f0ab13b-b662-4874-80cb-e1e32769bdb0 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:53.325872 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-4f0ab13b-b662-4874-80cb-e1e32769bdb0 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1519 microversion: 2.1 time: 0.627186 Nov 20 03:29:53.328530 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 446/821] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:52 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1519 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:53.394728 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-a3d05f35-b917-481b-8c3d-94f3731a1d5a tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:53.395347 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-a3d05f35-b917-481b-8c3d-94f3731a1d5a tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: 51fdb082-29f4-42ab-96d3-86dcfd59910c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:53.403654 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a3d05f35-b917-481b-8c3d-94f3731a1d5a tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:53.409117 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a3d05f35-b917-481b-8c3d-94f3731a1d5a tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:53.409959 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a3d05f35-b917-481b-8c3d-94f3731a1d5a tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:53.410401 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a3d05f35-b917-481b-8c3d-94f3731a1d5a tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:53.487468 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-df4a8f45-770a-4d65-95d4-1f359f93dea3 req-cf3d4c8c-05f3-44ba-937a-04582c1d8e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd", "name": "network-vif-unplugged", "status": "completed", "tag": "c4f59d4b-9c47-44dc-ae92-832b37f470bd"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:53.490078 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:29:53.490078 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:29:53.503407 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-df4a8f45-770a-4d65-95d4-1f359f93dea3 req-cf3d4c8c-05f3-44ba-937a-04582c1d8e16 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:53.506250 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-df4a8f45-770a-4d65-95d4-1f359f93dea3 req-cf3d4c8c-05f3-44ba-937a-04582c1d8e16 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:53.522513 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-df4a8f45-770a-4d65-95d4-1f359f93dea3 req-cf3d4c8c-05f3-44ba-937a-04582c1d8e16 service nova] Creating event network-vif-unplugged:c4f59d4b-9c47-44dc-ae92-832b37f470bd for instance 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd on hv-cinder-81803 Nov 20 03:29:53.538614 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-df4a8f45-770a-4d65-95d4-1f359f93dea3 req-cf3d4c8c-05f3-44ba-937a-04582c1d8e16 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.355613 Nov 20 03:29:53.540545 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 376/822] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:29:53 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:29:53.738358 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a3d05f35-b917-481b-8c3d-94f3731a1d5a tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:53.753216 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-a3d05f35-b917-481b-8c3d-94f3731a1d5a tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c" status: 200 len: 1319 microversion: 2.1 time: 0.363378 Nov 20 03:29:53.765372 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 447/823] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:53 2021] GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c => generated 1319 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:29:54.228482 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-79496e84-e638-41cf-9e03-79bf70592347 req-21f5c9d3-1d94-43a5-8f95-58ce9a6845ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51fdb082-29f4-42ab-96d3-86dcfd59910c", "tag": "569f4ec5-7ea9-449a-b464-3b76e47b73a2"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:54.230366 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:29:54.230366 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:29:54.266372 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-79496e84-e638-41cf-9e03-79bf70592347 req-21f5c9d3-1d94-43a5-8f95-58ce9a6845ef service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:54.267077 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-79496e84-e638-41cf-9e03-79bf70592347 req-21f5c9d3-1d94-43a5-8f95-58ce9a6845ef service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:54.297912 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-79496e84-e638-41cf-9e03-79bf70592347 req-21f5c9d3-1d94-43a5-8f95-58ce9a6845ef service nova] Creating event network-changed:569f4ec5-7ea9-449a-b464-3b76e47b73a2 for instance 51fdb082-29f4-42ab-96d3-86dcfd59910c on hv-cinder-81803 Nov 20 03:29:54.317241 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-79496e84-e638-41cf-9e03-79bf70592347 req-21f5c9d3-1d94-43a5-8f95-58ce9a6845ef service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094010 Nov 20 03:29:54.319133 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 377/824] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:29:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:29:54.345882 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-d05140fc-7bcb-485c-9017-43bf81e4b9d2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:54.346918 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-d05140fc-7bcb-485c-9017-43bf81e4b9d2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:54.367338 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d05140fc-7bcb-485c-9017-43bf81e4b9d2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:54.385893 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d05140fc-7bcb-485c-9017-43bf81e4b9d2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:54.387662 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d05140fc-7bcb-485c-9017-43bf81e4b9d2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:54.389493 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d05140fc-7bcb-485c-9017-43bf81e4b9d2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:54.764928 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-436d8564-6ebe-42d7-847a-62c87cee16b5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:54.766163 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-436d8564-6ebe-42d7-847a-62c87cee16b5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:54.775515 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-436d8564-6ebe-42d7-847a-62c87cee16b5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:54.776944 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-436d8564-6ebe-42d7-847a-62c87cee16b5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:54.778630 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-436d8564-6ebe-42d7-847a-62c87cee16b5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:54.779306 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-436d8564-6ebe-42d7-847a-62c87cee16b5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:54.829366 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-d05140fc-7bcb-485c-9017-43bf81e4b9d2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:54.833737 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.objects.instance [None req-436d8564-6ebe-42d7-847a-62c87cee16b5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lazy-loading 'flavor' on Instance uuid eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 {{(pid=116114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 03:29:54.841673 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-d05140fc-7bcb-485c-9017-43bf81e4b9d2 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1575 microversion: 2.1 time: 0.499954 Nov 20 03:29:54.843838 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 448/825] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:54 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1575 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:54.851824 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-a4eeb96e-325c-4a4e-ace6-3c9d23660516 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:54.852785 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-a4eeb96e-325c-4a4e-ace6-3c9d23660516 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: 51fdb082-29f4-42ab-96d3-86dcfd59910c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:54.860954 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a4eeb96e-325c-4a4e-ace6-3c9d23660516 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:54.861672 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a4eeb96e-325c-4a4e-ace6-3c9d23660516 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:54.862761 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a4eeb96e-325c-4a4e-ace6-3c9d23660516 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:54.863420 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a4eeb96e-325c-4a4e-ace6-3c9d23660516 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:55.132139 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a4eeb96e-325c-4a4e-ace6-3c9d23660516 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:55.140728 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-a4eeb96e-325c-4a4e-ace6-3c9d23660516 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c" status: 200 len: 1319 microversion: 2.1 time: 0.295566 Nov 20 03:29:55.143395 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 449/826] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:54 2021] GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:55.235673 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-436d8564-6ebe-42d7-847a-62c87cee16b5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 202 len: 0 microversion: 2.20 time: 0.478500 Nov 20 03:29:55.236369 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 378/827] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:29:54 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 20 03:29:55.245988 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-73cdf11f-ab9d-4ced-bf0a-b900c38dc9a6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:55.247008 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-73cdf11f-ab9d-4ced-bf0a-b900c38dc9a6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:55.254442 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-73cdf11f-ab9d-4ced-bf0a-b900c38dc9a6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:55.254894 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-73cdf11f-ab9d-4ced-bf0a-b900c38dc9a6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:55.255693 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-73cdf11f-ab9d-4ced-bf0a-b900c38dc9a6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:55.256174 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-73cdf11f-ab9d-4ced-bf0a-b900c38dc9a6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:55.525764 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-73cdf11f-ab9d-4ced-bf0a-b900c38dc9a6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:55.553994 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-73cdf11f-ab9d-4ced-bf0a-b900c38dc9a6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:55.555853 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-73cdf11f-ab9d-4ced-bf0a-b900c38dc9a6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:55.565988 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-73cdf11f-ab9d-4ced-bf0a-b900c38dc9a6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1721 microversion: 2.20 time: 0.324625 Nov 20 03:29:55.566961 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 450/828] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:29:55 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1721 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:29:55.861813 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-222b4397-7636-423d-b92f-093622703707 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:55.863273 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-222b4397-7636-423d-b92f-093622703707 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:55.874963 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-222b4397-7636-423d-b92f-093622703707 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:55.876274 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-222b4397-7636-423d-b92f-093622703707 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:55.877774 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-222b4397-7636-423d-b92f-093622703707 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:55.878321 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-222b4397-7636-423d-b92f-093622703707 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:56.060877 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-222b4397-7636-423d-b92f-093622703707 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:56.071898 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-222b4397-7636-423d-b92f-093622703707 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1575 microversion: 2.1 time: 0.215162 Nov 20 03:29:56.072414 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 379/829] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:55 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1575 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:56.158800 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-33b5a04c-ab5c-46dd-83ab-06beecd32673 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:56.159528 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-33b5a04c-ab5c-46dd-83ab-06beecd32673 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: 51fdb082-29f4-42ab-96d3-86dcfd59910c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:56.167663 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-33b5a04c-ab5c-46dd-83ab-06beecd32673 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:56.168246 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-33b5a04c-ab5c-46dd-83ab-06beecd32673 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:56.169143 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-33b5a04c-ab5c-46dd-83ab-06beecd32673 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:56.169685 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-33b5a04c-ab5c-46dd-83ab-06beecd32673 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:56.326416 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-33b5a04c-ab5c-46dd-83ab-06beecd32673 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:56.334304 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-33b5a04c-ab5c-46dd-83ab-06beecd32673 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c" status: 200 len: 1319 microversion: 2.1 time: 0.179333 Nov 20 03:29:56.337916 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 451/830] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:56 2021] GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:56.586497 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-eed3214d-1846-4155-922f-97005b3ee1bd tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:56.587372 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-eed3214d-1846-4155-922f-97005b3ee1bd tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:56.594020 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-eed3214d-1846-4155-922f-97005b3ee1bd tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:56.594948 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-eed3214d-1846-4155-922f-97005b3ee1bd tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:56.597282 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-eed3214d-1846-4155-922f-97005b3ee1bd tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:56.597946 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-eed3214d-1846-4155-922f-97005b3ee1bd tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:56.769288 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-eed3214d-1846-4155-922f-97005b3ee1bd tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:56.782879 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-eed3214d-1846-4155-922f-97005b3ee1bd tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:56.785178 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-eed3214d-1846-4155-922f-97005b3ee1bd tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:56.786838 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-eed3214d-1846-4155-922f-97005b3ee1bd tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1721 microversion: 2.20 time: 0.204152 Nov 20 03:29:56.799152 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 380/831] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:29:56 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:29:57.089312 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ad4ab69d-b05c-46a9-a30b-b159b0bb91a1 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:57.090588 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ad4ab69d-b05c-46a9-a30b-b159b0bb91a1 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:57.098046 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ad4ab69d-b05c-46a9-a30b-b159b0bb91a1 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:57.098489 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ad4ab69d-b05c-46a9-a30b-b159b0bb91a1 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:57.099468 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ad4ab69d-b05c-46a9-a30b-b159b0bb91a1 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:57.099933 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ad4ab69d-b05c-46a9-a30b-b159b0bb91a1 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:57.266157 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-ad4ab69d-b05c-46a9-a30b-b159b0bb91a1 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:57.274352 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ad4ab69d-b05c-46a9-a30b-b159b0bb91a1 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1575 microversion: 2.1 time: 0.188732 Nov 20 03:29:57.274916 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 452/832] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:57 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1575 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:57.350572 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-e0acf0ea-8959-475a-94af-ad7284a46828 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:57.351355 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-e0acf0ea-8959-475a-94af-ad7284a46828 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: 51fdb082-29f4-42ab-96d3-86dcfd59910c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:57.358175 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e0acf0ea-8959-475a-94af-ad7284a46828 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:57.358337 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e0acf0ea-8959-475a-94af-ad7284a46828 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:57.359139 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e0acf0ea-8959-475a-94af-ad7284a46828 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:57.359552 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e0acf0ea-8959-475a-94af-ad7284a46828 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:57.510719 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-e0acf0ea-8959-475a-94af-ad7284a46828 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:57.518225 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-e0acf0ea-8959-475a-94af-ad7284a46828 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c" status: 200 len: 1319 microversion: 2.1 time: 0.171309 Nov 20 03:29:57.519003 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 381/833] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:57 2021] GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:57.806336 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-1756473c-0dba-4162-b96c-8c1fb9125929 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:57.806923 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-1756473c-0dba-4162-b96c-8c1fb9125929 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:57.813665 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1756473c-0dba-4162-b96c-8c1fb9125929 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:57.814107 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1756473c-0dba-4162-b96c-8c1fb9125929 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:57.814897 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1756473c-0dba-4162-b96c-8c1fb9125929 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:57.815331 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1756473c-0dba-4162-b96c-8c1fb9125929 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:57.967288 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-1756473c-0dba-4162-b96c-8c1fb9125929 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:57.976460 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-1756473c-0dba-4162-b96c-8c1fb9125929 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:57.978164 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-1756473c-0dba-4162-b96c-8c1fb9125929 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:57.979376 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-1756473c-0dba-4162-b96c-8c1fb9125929 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1721 microversion: 2.20 time: 0.177434 Nov 20 03:29:57.979971 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 453/834] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:29:57 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:29:58.291291 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-d70e747d-0aab-4802-93de-19e72cae9b50 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:58.291928 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-d70e747d-0aab-4802-93de-19e72cae9b50 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:58.297863 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d70e747d-0aab-4802-93de-19e72cae9b50 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:58.300361 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d70e747d-0aab-4802-93de-19e72cae9b50 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:58.300361 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d70e747d-0aab-4802-93de-19e72cae9b50 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:58.300361 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d70e747d-0aab-4802-93de-19e72cae9b50 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:58.447142 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-d70e747d-0aab-4802-93de-19e72cae9b50 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:58.456503 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-d70e747d-0aab-4802-93de-19e72cae9b50 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1575 microversion: 2.1 time: 0.169164 Nov 20 03:29:58.457982 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 382/835] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:58 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:58.536672 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-3644b24a-389f-45d6-9c44-9d4301649393 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:58.537329 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-3644b24a-389f-45d6-9c44-9d4301649393 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: 51fdb082-29f4-42ab-96d3-86dcfd59910c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:58.550373 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3644b24a-389f-45d6-9c44-9d4301649393 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:58.550870 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3644b24a-389f-45d6-9c44-9d4301649393 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:58.551773 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3644b24a-389f-45d6-9c44-9d4301649393 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:58.559018 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3644b24a-389f-45d6-9c44-9d4301649393 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:58.689177 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-4453b97b-83f3-4385-9d1d-1b7474b31301 req-3250ac5a-056f-448a-8fca-1900c0431c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51fdb082-29f4-42ab-96d3-86dcfd59910c", "name": "network-vif-plugged", "status": "completed", "tag": "569f4ec5-7ea9-449a-b464-3b76e47b73a2"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:29:58.691341 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:29:58.691341 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:29:58.705387 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-4453b97b-83f3-4385-9d1d-1b7474b31301 req-3250ac5a-056f-448a-8fca-1900c0431c81 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:58.705913 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-4453b97b-83f3-4385-9d1d-1b7474b31301 req-3250ac5a-056f-448a-8fca-1900c0431c81 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:58.716289 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-3644b24a-389f-45d6-9c44-9d4301649393 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:58.721511 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-4453b97b-83f3-4385-9d1d-1b7474b31301 req-3250ac5a-056f-448a-8fca-1900c0431c81 service nova] Creating event network-vif-plugged:569f4ec5-7ea9-449a-b464-3b76e47b73a2 for instance 51fdb082-29f4-42ab-96d3-86dcfd59910c on hv-cinder-81803 Nov 20 03:29:58.724315 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-3644b24a-389f-45d6-9c44-9d4301649393 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c" status: 200 len: 1319 microversion: 2.1 time: 0.191838 Nov 20 03:29:58.727532 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-4453b97b-83f3-4385-9d1d-1b7474b31301 req-3250ac5a-056f-448a-8fca-1900c0431c81 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042504 Nov 20 03:29:58.728506 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 383/836] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:29:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:29:58.741139 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 454/837] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:58 2021] GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:29:58.999540 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-dd2a12fd-5ca4-4d97-ba49-55e1e935d561 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:59.000278 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-dd2a12fd-5ca4-4d97-ba49-55e1e935d561 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:59.006788 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dd2a12fd-5ca4-4d97-ba49-55e1e935d561 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:59.007239 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dd2a12fd-5ca4-4d97-ba49-55e1e935d561 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:59.008066 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dd2a12fd-5ca4-4d97-ba49-55e1e935d561 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:59.008499 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dd2a12fd-5ca4-4d97-ba49-55e1e935d561 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:59.162604 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-dd2a12fd-5ca4-4d97-ba49-55e1e935d561 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:59.171641 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-dd2a12fd-5ca4-4d97-ba49-55e1e935d561 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:59.173698 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-dd2a12fd-5ca4-4d97-ba49-55e1e935d561 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:59.174888 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-dd2a12fd-5ca4-4d97-ba49-55e1e935d561 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1721 microversion: 2.20 time: 0.179916 Nov 20 03:29:59.175472 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 384/838] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:29:58 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:29:59.478788 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-3a291a69-2bb5-49e6-b32b-440311cebe95 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:59.479957 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-3a291a69-2bb5-49e6-b32b-440311cebe95 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:59.489620 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3a291a69-2bb5-49e6-b32b-440311cebe95 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:59.490174 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3a291a69-2bb5-49e6-b32b-440311cebe95 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:59.491160 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3a291a69-2bb5-49e6-b32b-440311cebe95 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:59.492140 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3a291a69-2bb5-49e6-b32b-440311cebe95 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:59.643296 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-3a291a69-2bb5-49e6-b32b-440311cebe95 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:59.651610 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-3a291a69-2bb5-49e6-b32b-440311cebe95 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1575 microversion: 2.1 time: 0.177032 Nov 20 03:29:59.652819 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 455/839] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:59 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:29:59.742106 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-1d400a41-03ce-464e-8cfa-6b0966115753 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:29:59.742696 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-1d400a41-03ce-464e-8cfa-6b0966115753 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: 51fdb082-29f4-42ab-96d3-86dcfd59910c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:29:59.748950 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1d400a41-03ce-464e-8cfa-6b0966115753 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:59.749392 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1d400a41-03ce-464e-8cfa-6b0966115753 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:59.750419 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1d400a41-03ce-464e-8cfa-6b0966115753 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:29:59.751065 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1d400a41-03ce-464e-8cfa-6b0966115753 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:29:59.895186 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-1d400a41-03ce-464e-8cfa-6b0966115753 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:29:59.909762 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-1d400a41-03ce-464e-8cfa-6b0966115753 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c" status: 200 len: 1319 microversion: 2.1 time: 0.171735 Nov 20 03:29:59.913127 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 385/840] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:29:59 2021] GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:00.194086 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-47b4db94-b9c8-4ec3-be0a-9b1eb17ccee7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:00.194704 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-47b4db94-b9c8-4ec3-be0a-9b1eb17ccee7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:00.201410 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-47b4db94-b9c8-4ec3-be0a-9b1eb17ccee7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:00.201861 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-47b4db94-b9c8-4ec3-be0a-9b1eb17ccee7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:00.202658 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-47b4db94-b9c8-4ec3-be0a-9b1eb17ccee7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:00.203101 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-47b4db94-b9c8-4ec3-be0a-9b1eb17ccee7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:00.343224 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-47b4db94-b9c8-4ec3-be0a-9b1eb17ccee7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:00.352373 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-47b4db94-b9c8-4ec3-be0a-9b1eb17ccee7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:00.353883 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-47b4db94-b9c8-4ec3-be0a-9b1eb17ccee7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:00.355083 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-47b4db94-b9c8-4ec3-be0a-9b1eb17ccee7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1721 microversion: 2.20 time: 0.164661 Nov 20 03:30:00.355960 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 456/841] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:00 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:00.668775 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-77a6ffd9-af67-4b50-b6e1-42548b958147 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:00.669385 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-77a6ffd9-af67-4b50-b6e1-42548b958147 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:00.675915 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-77a6ffd9-af67-4b50-b6e1-42548b958147 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:00.676362 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-77a6ffd9-af67-4b50-b6e1-42548b958147 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:00.677127 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-77a6ffd9-af67-4b50-b6e1-42548b958147 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:00.677565 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-77a6ffd9-af67-4b50-b6e1-42548b958147 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:00.826433 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-77a6ffd9-af67-4b50-b6e1-42548b958147 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:00.837565 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-77a6ffd9-af67-4b50-b6e1-42548b958147 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1575 microversion: 2.1 time: 0.171906 Nov 20 03:30:00.838416 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 386/842] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:00 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:00.926720 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-385e57a2-4128-4235-9337-59f8096bd35b tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:00.927350 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-385e57a2-4128-4235-9337-59f8096bd35b tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: 51fdb082-29f4-42ab-96d3-86dcfd59910c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:00.934282 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-385e57a2-4128-4235-9337-59f8096bd35b tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:00.934734 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-385e57a2-4128-4235-9337-59f8096bd35b tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:00.935526 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-385e57a2-4128-4235-9337-59f8096bd35b tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:00.936280 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-385e57a2-4128-4235-9337-59f8096bd35b tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:01.076069 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-385e57a2-4128-4235-9337-59f8096bd35b tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:01.083534 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-385e57a2-4128-4235-9337-59f8096bd35b tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c" status: 200 len: 1508 microversion: 2.1 time: 0.160712 Nov 20 03:30:01.095573 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 457/843] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:00 2021] GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:01.101458 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-6ba69328-857c-46ac-9d15-94d3e1f19fd3 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1300d7e0-2abd-4911-bec1-41cd1e02369f", "device": "/dev/sdb"}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:30:01.102941 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-6ba69328-857c-46ac-9d15-94d3e1f19fd3 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: 51fdb082-29f4-42ab-96d3-86dcfd59910c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:01.110115 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6ba69328-857c-46ac-9d15-94d3e1f19fd3 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:01.110819 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6ba69328-857c-46ac-9d15-94d3e1f19fd3 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:01.111859 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6ba69328-857c-46ac-9d15-94d3e1f19fd3 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:01.112466 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6ba69328-857c-46ac-9d15-94d3e1f19fd3 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:01.374664 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-d30d31eb-b502-4221-a95b-1846266ead9c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:01.375293 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-d30d31eb-b502-4221-a95b-1846266ead9c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:01.382919 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d30d31eb-b502-4221-a95b-1846266ead9c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:01.383525 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d30d31eb-b502-4221-a95b-1846266ead9c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:01.384439 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d30d31eb-b502-4221-a95b-1846266ead9c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:01.384942 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d30d31eb-b502-4221-a95b-1846266ead9c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:01.401232 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-6ba69328-857c-46ac-9d15-94d3e1f19fd3 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "POST /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303456 Nov 20 03:30:01.402208 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 387/844] 10.222.0.37 () {60 vars in 1322 bytes} [Sat Nov 20 03:30:01 2021] POST /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:30:01.529620 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-23127419-09b2-491b-9678-2ad88e889a72 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Action: 'create', calling method: .version_select at 0x7f2dac8ad820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1301509369"}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:30:01.533091 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-d30d31eb-b502-4221-a95b-1846266ead9c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:01.541968 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-d30d31eb-b502-4221-a95b-1846266ead9c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:01.543733 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-d30d31eb-b502-4221-a95b-1846266ead9c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:01.543921 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-23127419-09b2-491b-9678-2ad88e889a72 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Getting quotas for project c53d3d6966164babbb24206f254ee2d5. Resources: {'key_pairs'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:30:01.544995 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-d30d31eb-b502-4221-a95b-1846266ead9c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1721 microversion: 2.20 time: 0.174422 Nov 20 03:30:01.545905 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 458/845] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:01 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:30:01.547898 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-23127419-09b2-491b-9678-2ad88e889a72 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Getting quotas for user 5079359cad0342bfbefd6c33f39a93a0 and project c53d3d6966164babbb24206f254ee2d5. Resources: {'key_pairs'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:30:01.741742 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-23127419-09b2-491b-9678-2ad88e889a72 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Getting quotas for project c53d3d6966164babbb24206f254ee2d5. Resources: {'key_pairs'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:30:01.745386 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-23127419-09b2-491b-9678-2ad88e889a72 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Getting quotas for user 5079359cad0342bfbefd6c33f39a93a0 and project c53d3d6966164babbb24206f254ee2d5. Resources: {'key_pairs'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:30:01.758355 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-23127419-09b2-491b-9678-2ad88e889a72 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.233301 Nov 20 03:30:01.758948 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 388/846] 10.222.0.37 () {60 vars in 1157 bytes} [Sat Nov 20 03:30:01 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:30:01.807247 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-e7d9a378-4f9e-46ed-b636-5285dd03708b tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1405104350", "imageRef": "cfb73783-3cee-4ea9-8181-61d42e090526", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1301509369", "networks": [{"uuid": "ed709e46-1ee1-428c-b518-8aac59c8ccf4"}]}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:30:01.855263 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-16bf43c9-f048-4b7d-8016-7993a9f652d7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:01.856023 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-16bf43c9-f048-4b7d-8016-7993a9f652d7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:01.856914 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.network.neutron [None req-e7d9a378-4f9e-46ed-b636-5285dd03708b tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] validate_networks() for [('ed709e46-1ee1-428c-b518-8aac59c8ccf4', None, None, None, None, None)] {{(pid=116113) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 03:30:01.862678 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-16bf43c9-f048-4b7d-8016-7993a9f652d7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:01.864781 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-16bf43c9-f048-4b7d-8016-7993a9f652d7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:01.864781 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-16bf43c9-f048-4b7d-8016-7993a9f652d7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:01.864781 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-16bf43c9-f048-4b7d-8016-7993a9f652d7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:02.089262 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-16bf43c9-f048-4b7d-8016-7993a9f652d7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:02.096818 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-16bf43c9-f048-4b7d-8016-7993a9f652d7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1575 microversion: 2.1 time: 0.245763 Nov 20 03:30:02.097382 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 389/847] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:01 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1575 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:30:02.556523 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-e7d9a378-4f9e-46ed-b636-5285dd03708b tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Flavor limits 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 03:30:02.557757 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-e7d9a378-4f9e-46ed-b636-5285dd03708b tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Image limits 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 03:30:02.558439 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-e7d9a378-4f9e-46ed-b636-5285dd03708b tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Flavor pref 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 03:30:02.558921 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-e7d9a378-4f9e-46ed-b636-5285dd03708b tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Image pref 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 03:30:02.559417 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-e7d9a378-4f9e-46ed-b636-5285dd03708b tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 03:30:02.563692 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-bc890483-2a96-4a21-8c99-4e8d0828ef1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:02.564406 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-bc890483-2a96-4a21-8c99-4e8d0828ef1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:02.570172 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e7d9a378-4f9e-46ed-b636-5285dd03708b tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:02.570622 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e7d9a378-4f9e-46ed-b636-5285dd03708b tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:02.571071 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bc890483-2a96-4a21-8c99-4e8d0828ef1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:02.571445 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e7d9a378-4f9e-46ed-b636-5285dd03708b tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:02.571692 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bc890483-2a96-4a21-8c99-4e8d0828ef1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:02.571980 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e7d9a378-4f9e-46ed-b636-5285dd03708b tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:02.572649 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bc890483-2a96-4a21-8c99-4e8d0828ef1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:02.573326 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bc890483-2a96-4a21-8c99-4e8d0828ef1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:02.589123 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-e7d9a378-4f9e-46ed-b636-5285dd03708b tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Getting quotas for project c53d3d6966164babbb24206f254ee2d5. Resources: {'ram', 'cores', 'instances'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:30:02.593158 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-e7d9a378-4f9e-46ed-b636-5285dd03708b tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Getting quotas for user 5079359cad0342bfbefd6c33f39a93a0 and project c53d3d6966164babbb24206f254ee2d5. Resources: {'ram', 'cores', 'instances'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:30:02.605701 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-e7d9a378-4f9e-46ed-b636-5285dd03708b tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Going to run 1 instances... {{(pid=116113) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 03:30:02.608813 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-e7d9a378-4f9e-46ed-b636-5285dd03708b tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cfb73783-3cee-4ea9-8181-61d42e090526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 03:30:02.655154 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-e7d9a378-4f9e-46ed-b636-5285dd03708b tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.851978 Nov 20 03:30:02.655990 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 459/848] 10.222.0.37 () {60 vars in 1146 bytes} [Sat Nov 20 03:30:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 03:30:02.665665 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-b8a01edd-86d3-4353-ba02-701eb5a1a062 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:02.666401 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-b8a01edd-86d3-4353-ba02-701eb5a1a062 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:02.729981 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-b8a01edd-86d3-4353-ba02-701eb5a1a062 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:02.737765 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-b8a01edd-86d3-4353-ba02-701eb5a1a062 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1259 microversion: 2.1 time: 0.076018 Nov 20 03:30:02.738526 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 460/849] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:02 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1259 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:30:02.745558 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-bc890483-2a96-4a21-8c99-4e8d0828ef1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:02.754781 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-bc890483-2a96-4a21-8c99-4e8d0828ef1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:02.756313 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-bc890483-2a96-4a21-8c99-4e8d0828ef1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:02.757482 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-bc890483-2a96-4a21-8c99-4e8d0828ef1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1721 microversion: 2.20 time: 0.197754 Nov 20 03:30:02.768702 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 390/850] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:02 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:03.113999 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ea83d684-40fc-415c-9a0b-51d8a25b9c09 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:03.114825 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ea83d684-40fc-415c-9a0b-51d8a25b9c09 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:03.123091 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ea83d684-40fc-415c-9a0b-51d8a25b9c09 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:03.123546 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ea83d684-40fc-415c-9a0b-51d8a25b9c09 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:03.124536 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ea83d684-40fc-415c-9a0b-51d8a25b9c09 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:03.125150 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ea83d684-40fc-415c-9a0b-51d8a25b9c09 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:03.268707 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-ea83d684-40fc-415c-9a0b-51d8a25b9c09 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:03.276708 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ea83d684-40fc-415c-9a0b-51d8a25b9c09 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1575 microversion: 2.1 time: 0.166765 Nov 20 03:30:03.277372 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 461/851] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:03 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:03.756842 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-ded1de44-5aab-4e45-a112-50742241a036 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:03.757448 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-ded1de44-5aab-4e45-a112-50742241a036 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:03.764335 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ded1de44-5aab-4e45-a112-50742241a036 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:03.764817 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ded1de44-5aab-4e45-a112-50742241a036 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:03.765687 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ded1de44-5aab-4e45-a112-50742241a036 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:03.766122 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ded1de44-5aab-4e45-a112-50742241a036 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:03.777307 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-0f538cf5-a394-4723-a565-b8735eca2a7a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:03.777836 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-0f538cf5-a394-4723-a565-b8735eca2a7a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:03.784433 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0f538cf5-a394-4723-a565-b8735eca2a7a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:03.784899 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0f538cf5-a394-4723-a565-b8735eca2a7a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:03.785673 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0f538cf5-a394-4723-a565-b8735eca2a7a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:03.786095 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0f538cf5-a394-4723-a565-b8735eca2a7a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:03.859913 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-ded1de44-5aab-4e45-a112-50742241a036 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:03.867584 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-ded1de44-5aab-4e45-a112-50742241a036 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1329 microversion: 2.1 time: 0.116206 Nov 20 03:30:03.868208 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 391/852] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:03 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1329 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:30:04.042688 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-0f538cf5-a394-4723-a565-b8735eca2a7a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:04.051496 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-0f538cf5-a394-4723-a565-b8735eca2a7a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:04.053352 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-0f538cf5-a394-4723-a565-b8735eca2a7a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:04.054777 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-0f538cf5-a394-4723-a565-b8735eca2a7a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1721 microversion: 2.20 time: 0.282358 Nov 20 03:30:04.055389 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 462/853] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:03 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1721 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:30:04.296928 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-d92f5b16-75c1-4de6-9406-408392621b37 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:04.297646 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-d92f5b16-75c1-4de6-9406-408392621b37 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:04.307240 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d92f5b16-75c1-4de6-9406-408392621b37 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:04.307697 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d92f5b16-75c1-4de6-9406-408392621b37 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:04.308548 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d92f5b16-75c1-4de6-9406-408392621b37 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:04.308989 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d92f5b16-75c1-4de6-9406-408392621b37 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:04.581289 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-d92f5b16-75c1-4de6-9406-408392621b37 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:04.594513 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-d92f5b16-75c1-4de6-9406-408392621b37 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1575 microversion: 2.1 time: 0.301854 Nov 20 03:30:04.598326 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 392/854] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:04 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1575 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:04.841793 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-aa28a7d9-e87b-4280-a76b-b6d1dc181cca req-0cbf36f0-32d7-439b-9b9a-585ceb76eae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd", "name": "network-vif-plugged", "status": "completed", "tag": "c4f59d4b-9c47-44dc-ae92-832b37f470bd"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:30:04.844394 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:30:04.844394 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:30:04.854895 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-aa28a7d9-e87b-4280-a76b-b6d1dc181cca req-0cbf36f0-32d7-439b-9b9a-585ceb76eae6 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:04.855424 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-aa28a7d9-e87b-4280-a76b-b6d1dc181cca req-0cbf36f0-32d7-439b-9b9a-585ceb76eae6 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:04.870331 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-aa28a7d9-e87b-4280-a76b-b6d1dc181cca req-0cbf36f0-32d7-439b-9b9a-585ceb76eae6 service nova] Creating event network-vif-plugged:c4f59d4b-9c47-44dc-ae92-832b37f470bd for instance 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd on hv-cinder-81803 Nov 20 03:30:04.875412 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-aa28a7d9-e87b-4280-a76b-b6d1dc181cca req-0cbf36f0-32d7-439b-9b9a-585ceb76eae6 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037672 Nov 20 03:30:04.876551 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 463/855] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:30:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:30:04.896353 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-5965f2a8-139f-4029-a763-a6cdeb4db571 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:04.899356 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-5965f2a8-139f-4029-a763-a6cdeb4db571 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:04.907060 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5965f2a8-139f-4029-a763-a6cdeb4db571 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:04.907715 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5965f2a8-139f-4029-a763-a6cdeb4db571 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:04.908750 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5965f2a8-139f-4029-a763-a6cdeb4db571 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:04.909347 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5965f2a8-139f-4029-a763-a6cdeb4db571 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:05.057878 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-5965f2a8-139f-4029-a763-a6cdeb4db571 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:05.065322 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-5965f2a8-139f-4029-a763-a6cdeb4db571 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1359 microversion: 2.1 time: 0.184381 Nov 20 03:30:05.065893 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 393/856] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:04 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:05.073217 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-e1f199e7-e80e-4867-ba50-94e9de69a481 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:05.073855 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-e1f199e7-e80e-4867-ba50-94e9de69a481 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:05.080114 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e1f199e7-e80e-4867-ba50-94e9de69a481 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:05.080560 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e1f199e7-e80e-4867-ba50-94e9de69a481 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:05.081325 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e1f199e7-e80e-4867-ba50-94e9de69a481 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:05.081751 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e1f199e7-e80e-4867-ba50-94e9de69a481 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:05.223380 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-e1f199e7-e80e-4867-ba50-94e9de69a481 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:05.231304 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-e1f199e7-e80e-4867-ba50-94e9de69a481 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:05.232869 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-e1f199e7-e80e-4867-ba50-94e9de69a481 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:05.234043 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-e1f199e7-e80e-4867-ba50-94e9de69a481 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1721 microversion: 2.20 time: 0.165449 Nov 20 03:30:05.234602 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 464/857] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:05 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:05.617035 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-73f02dab-ad85-457f-a25c-9b48dfc34240 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:05.617645 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-73f02dab-ad85-457f-a25c-9b48dfc34240 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:05.623424 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-73f02dab-ad85-457f-a25c-9b48dfc34240 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:05.623897 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-73f02dab-ad85-457f-a25c-9b48dfc34240 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:05.624665 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-73f02dab-ad85-457f-a25c-9b48dfc34240 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:05.625091 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-73f02dab-ad85-457f-a25c-9b48dfc34240 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:05.775332 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-73f02dab-ad85-457f-a25c-9b48dfc34240 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:05.783100 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-73f02dab-ad85-457f-a25c-9b48dfc34240 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1575 microversion: 2.1 time: 0.169657 Nov 20 03:30:05.783670 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 394/858] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:05 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:06.082191 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-d2c20325-7260-4777-9980-1bbb0167b999 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:06.082829 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-d2c20325-7260-4777-9980-1bbb0167b999 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:06.089095 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d2c20325-7260-4777-9980-1bbb0167b999 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:06.089549 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d2c20325-7260-4777-9980-1bbb0167b999 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:06.090329 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d2c20325-7260-4777-9980-1bbb0167b999 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:06.090771 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d2c20325-7260-4777-9980-1bbb0167b999 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:06.233633 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-d2c20325-7260-4777-9980-1bbb0167b999 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:06.240921 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-d2c20325-7260-4777-9980-1bbb0167b999 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1359 microversion: 2.1 time: 0.162405 Nov 20 03:30:06.241485 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 465/859] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:06 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:06.252845 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-572b4243-7b47-499b-9004-a80629989f7d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:06.253455 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-572b4243-7b47-499b-9004-a80629989f7d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:06.260436 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-572b4243-7b47-499b-9004-a80629989f7d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:06.260873 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-572b4243-7b47-499b-9004-a80629989f7d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:06.261680 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-572b4243-7b47-499b-9004-a80629989f7d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:06.262114 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-572b4243-7b47-499b-9004-a80629989f7d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:06.396091 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-572b4243-7b47-499b-9004-a80629989f7d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:06.404197 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-572b4243-7b47-499b-9004-a80629989f7d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:06.405707 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-572b4243-7b47-499b-9004-a80629989f7d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:06.406866 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-572b4243-7b47-499b-9004-a80629989f7d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1721 microversion: 2.20 time: 0.157846 Nov 20 03:30:06.407428 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 395/860] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:06 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:06.684805 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-f395c3a8-1e66-48cc-8c35-318cdb6f5041 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:06.685302 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f395c3a8-1e66-48cc-8c35-318cdb6f5041 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:06.691428 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f395c3a8-1e66-48cc-8c35-318cdb6f5041 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:06.691932 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f395c3a8-1e66-48cc-8c35-318cdb6f5041 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:06.692719 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f395c3a8-1e66-48cc-8c35-318cdb6f5041 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:06.693151 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f395c3a8-1e66-48cc-8c35-318cdb6f5041 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:06.719041 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f395c3a8-1e66-48cc-8c35-318cdb6f5041 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Going to try to terminate instance {{(pid=116113) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 03:30:06.805939 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-d038090c-a7b1-4659-b2de-183707cec39c tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:06.806245 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-f395c3a8-1e66-48cc-8c35-318cdb6f5041 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "DELETE /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 204 len: 0 microversion: 2.1 time: 0.124784 Nov 20 03:30:06.807085 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 466/861] 10.222.0.37 () {58 vars in 1238 bytes} [Sat Nov 20 03:30:06 2021] DELETE /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 03:30:06.807432 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-d038090c-a7b1-4659-b2de-183707cec39c tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:06.813497 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d038090c-a7b1-4659-b2de-183707cec39c tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:06.813945 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d038090c-a7b1-4659-b2de-183707cec39c tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:06.814735 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d038090c-a7b1-4659-b2de-183707cec39c tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:06.815231 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d038090c-a7b1-4659-b2de-183707cec39c tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:06.815912 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-a163d9b8-2a2c-47e4-aa77-6a1c7b5204dd tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:06.816843 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-a163d9b8-2a2c-47e4-aa77-6a1c7b5204dd tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:06.825641 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a163d9b8-2a2c-47e4-aa77-6a1c7b5204dd tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:06.826188 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a163d9b8-2a2c-47e4-aa77-6a1c7b5204dd tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:06.827085 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a163d9b8-2a2c-47e4-aa77-6a1c7b5204dd tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:06.827530 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a163d9b8-2a2c-47e4-aa77-6a1c7b5204dd tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:07.024812 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-d038090c-a7b1-4659-b2de-183707cec39c tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:07.030652 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a163d9b8-2a2c-47e4-aa77-6a1c7b5204dd tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:07.032551 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-d038090c-a7b1-4659-b2de-183707cec39c tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1575 microversion: 2.1 time: 0.236632 Nov 20 03:30:07.033131 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 396/862] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:06 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1575 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:07.038210 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-a163d9b8-2a2c-47e4-aa77-6a1c7b5204dd tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1578 microversion: 2.1 time: 0.227008 Nov 20 03:30:07.038759 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 467/863] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:06 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1578 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:30:07.259577 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-706566ed-9c19-4e77-b2b5-b92be8d9ba7c tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:07.260238 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-706566ed-9c19-4e77-b2b5-b92be8d9ba7c tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:07.266428 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-706566ed-9c19-4e77-b2b5-b92be8d9ba7c tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:07.266890 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-706566ed-9c19-4e77-b2b5-b92be8d9ba7c tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:07.267678 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-706566ed-9c19-4e77-b2b5-b92be8d9ba7c tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:07.268148 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-706566ed-9c19-4e77-b2b5-b92be8d9ba7c tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:07.401061 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-706566ed-9c19-4e77-b2b5-b92be8d9ba7c tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:07.408615 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-706566ed-9c19-4e77-b2b5-b92be8d9ba7c tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1359 microversion: 2.1 time: 0.153575 Nov 20 03:30:07.409189 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 397/864] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:07 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:07.425392 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-765322df-3e90-44b6-8aa3-0be8dcb16a45 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:07.426020 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-765322df-3e90-44b6-8aa3-0be8dcb16a45 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:07.432927 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-765322df-3e90-44b6-8aa3-0be8dcb16a45 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:07.433401 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-765322df-3e90-44b6-8aa3-0be8dcb16a45 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:07.434166 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-765322df-3e90-44b6-8aa3-0be8dcb16a45 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:07.434597 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-765322df-3e90-44b6-8aa3-0be8dcb16a45 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:07.571470 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-765322df-3e90-44b6-8aa3-0be8dcb16a45 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:07.579778 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-765322df-3e90-44b6-8aa3-0be8dcb16a45 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:07.581357 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-765322df-3e90-44b6-8aa3-0be8dcb16a45 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:07.582502 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-765322df-3e90-44b6-8aa3-0be8dcb16a45 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1721 microversion: 2.20 time: 0.160811 Nov 20 03:30:07.583055 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 468/865] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:07 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:08.050239 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-312f054d-07fe-4aef-8598-d887b8f627c7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:08.050873 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-312f054d-07fe-4aef-8598-d887b8f627c7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:08.056230 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-5c6fbae5-d215-4dc3-94a3-19780353c8fc tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:08.056846 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-5c6fbae5-d215-4dc3-94a3-19780353c8fc tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:08.057074 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-312f054d-07fe-4aef-8598-d887b8f627c7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:08.057544 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-312f054d-07fe-4aef-8598-d887b8f627c7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:08.058403 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-312f054d-07fe-4aef-8598-d887b8f627c7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:08.058795 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-312f054d-07fe-4aef-8598-d887b8f627c7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:08.062921 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5c6fbae5-d215-4dc3-94a3-19780353c8fc tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:08.063370 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5c6fbae5-d215-4dc3-94a3-19780353c8fc tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:08.064168 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5c6fbae5-d215-4dc3-94a3-19780353c8fc tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:08.064605 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5c6fbae5-d215-4dc3-94a3-19780353c8fc tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:08.263549 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-312f054d-07fe-4aef-8598-d887b8f627c7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:08.271283 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-312f054d-07fe-4aef-8598-d887b8f627c7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1575 microversion: 2.1 time: 0.224756 Nov 20 03:30:08.271863 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 398/866] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:08 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1575 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:08.280647 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-5c6fbae5-d215-4dc3-94a3-19780353c8fc tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:08.289528 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-5c6fbae5-d215-4dc3-94a3-19780353c8fc tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1578 microversion: 2.1 time: 0.236771 Nov 20 03:30:08.290121 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 469/867] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:08 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1578 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:30:08.427571 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-f4704eba-52a6-461f-8a93-c820b226bbc0 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:08.428326 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-f4704eba-52a6-461f-8a93-c820b226bbc0 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:08.436460 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f4704eba-52a6-461f-8a93-c820b226bbc0 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:08.436918 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f4704eba-52a6-461f-8a93-c820b226bbc0 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:08.437773 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f4704eba-52a6-461f-8a93-c820b226bbc0 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:08.438180 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f4704eba-52a6-461f-8a93-c820b226bbc0 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:08.569454 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-f4704eba-52a6-461f-8a93-c820b226bbc0 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:08.581637 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-f4704eba-52a6-461f-8a93-c820b226bbc0 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1359 microversion: 2.1 time: 0.159258 Nov 20 03:30:08.582229 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 399/868] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:08 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:30:08.601930 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-391bfbc8-18ba-4ef5-8a93-46f15a961797 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:08.602547 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-391bfbc8-18ba-4ef5-8a93-46f15a961797 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:08.608870 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-391bfbc8-18ba-4ef5-8a93-46f15a961797 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:08.609324 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-391bfbc8-18ba-4ef5-8a93-46f15a961797 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:08.610101 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-391bfbc8-18ba-4ef5-8a93-46f15a961797 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:08.610541 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-391bfbc8-18ba-4ef5-8a93-46f15a961797 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:08.758985 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-391bfbc8-18ba-4ef5-8a93-46f15a961797 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:08.766938 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-391bfbc8-18ba-4ef5-8a93-46f15a961797 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:08.781671 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-391bfbc8-18ba-4ef5-8a93-46f15a961797 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:08.782945 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-391bfbc8-18ba-4ef5-8a93-46f15a961797 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1721 microversion: 2.20 time: 0.185150 Nov 20 03:30:08.783507 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 470/869] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:08 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:09.289361 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-ac084835-1a91-446f-a67c-aafb904eb7e6 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:09.290028 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-ac084835-1a91-446f-a67c-aafb904eb7e6 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:09.296252 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ac084835-1a91-446f-a67c-aafb904eb7e6 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:09.296704 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ac084835-1a91-446f-a67c-aafb904eb7e6 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:09.297485 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ac084835-1a91-446f-a67c-aafb904eb7e6 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:09.297926 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ac084835-1a91-446f-a67c-aafb904eb7e6 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:09.307203 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-c0f6aedf-0603-4ca8-869a-3104ce85f9fb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:09.307924 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-c0f6aedf-0603-4ca8-869a-3104ce85f9fb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:09.314253 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c0f6aedf-0603-4ca8-869a-3104ce85f9fb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:09.314708 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c0f6aedf-0603-4ca8-869a-3104ce85f9fb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:09.315508 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c0f6aedf-0603-4ca8-869a-3104ce85f9fb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:09.316459 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c0f6aedf-0603-4ca8-869a-3104ce85f9fb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:09.501169 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-ac084835-1a91-446f-a67c-aafb904eb7e6 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:09.509724 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-ac084835-1a91-446f-a67c-aafb904eb7e6 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1575 microversion: 2.1 time: 0.224514 Nov 20 03:30:09.510304 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 400/870] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:09 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1575 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:09.518585 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-c0f6aedf-0603-4ca8-869a-3104ce85f9fb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:09.526384 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-c0f6aedf-0603-4ca8-869a-3104ce85f9fb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1578 microversion: 2.1 time: 0.223585 Nov 20 03:30:09.535936 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 471/871] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:09 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1578 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:30:09.598726 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-96876d11-a4c0-4c63-8223-bb800900c9c9 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:09.599399 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-96876d11-a4c0-4c63-8223-bb800900c9c9 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:09.606106 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-96876d11-a4c0-4c63-8223-bb800900c9c9 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:09.606570 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-96876d11-a4c0-4c63-8223-bb800900c9c9 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:09.607350 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-96876d11-a4c0-4c63-8223-bb800900c9c9 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:09.607814 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-96876d11-a4c0-4c63-8223-bb800900c9c9 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:09.749132 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-96876d11-a4c0-4c63-8223-bb800900c9c9 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:09.756405 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-96876d11-a4c0-4c63-8223-bb800900c9c9 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1359 microversion: 2.1 time: 0.161650 Nov 20 03:30:09.756963 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 401/872] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:09 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:09.802345 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-91c517d9-7835-409b-bc0d-0deae1b4a6a0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:09.803000 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-91c517d9-7835-409b-bc0d-0deae1b4a6a0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:09.809277 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-91c517d9-7835-409b-bc0d-0deae1b4a6a0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:09.809729 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-91c517d9-7835-409b-bc0d-0deae1b4a6a0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:09.810513 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-91c517d9-7835-409b-bc0d-0deae1b4a6a0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:09.810946 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-91c517d9-7835-409b-bc0d-0deae1b4a6a0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:09.948451 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-91c517d9-7835-409b-bc0d-0deae1b4a6a0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:09.966375 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-91c517d9-7835-409b-bc0d-0deae1b4a6a0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:09.968147 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-91c517d9-7835-409b-bc0d-0deae1b4a6a0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:09.969414 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-91c517d9-7835-409b-bc0d-0deae1b4a6a0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1721 microversion: 2.20 time: 0.170749 Nov 20 03:30:09.970002 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 472/873] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:09 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:10.526758 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-8e30f9eb-fd59-41f7-808d-c7635caf76a8 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:10.528218 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-8e30f9eb-fd59-41f7-808d-c7635caf76a8 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:10.535338 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8e30f9eb-fd59-41f7-808d-c7635caf76a8 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:10.536352 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8e30f9eb-fd59-41f7-808d-c7635caf76a8 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:10.542407 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-823ed63f-9e71-46a0-836f-344760ee7704 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:10.543082 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8e30f9eb-fd59-41f7-808d-c7635caf76a8 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:10.543585 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-823ed63f-9e71-46a0-836f-344760ee7704 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:10.543715 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8e30f9eb-fd59-41f7-808d-c7635caf76a8 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:10.550309 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-823ed63f-9e71-46a0-836f-344760ee7704 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:10.551105 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-823ed63f-9e71-46a0-836f-344760ee7704 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:10.552011 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-823ed63f-9e71-46a0-836f-344760ee7704 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:10.552455 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-823ed63f-9e71-46a0-836f-344760ee7704 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:10.757257 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-823ed63f-9e71-46a0-836f-344760ee7704 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:10.761753 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-8e30f9eb-fd59-41f7-808d-c7635caf76a8 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:10.766665 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-823ed63f-9e71-46a0-836f-344760ee7704 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1578 microversion: 2.1 time: 0.227969 Nov 20 03:30:10.767577 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 473/874] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:10 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1578 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:10.772767 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-e8b8178a-76b2-4bed-b333-0ec3d50a5bfb tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:10.773529 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-e8b8178a-76b2-4bed-b333-0ec3d50a5bfb tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:10.781128 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-8e30f9eb-fd59-41f7-808d-c7635caf76a8 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1575 microversion: 2.1 time: 0.258092 Nov 20 03:30:10.786245 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e8b8178a-76b2-4bed-b333-0ec3d50a5bfb tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:10.787589 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e8b8178a-76b2-4bed-b333-0ec3d50a5bfb tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:10.789276 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e8b8178a-76b2-4bed-b333-0ec3d50a5bfb tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:10.789941 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e8b8178a-76b2-4bed-b333-0ec3d50a5bfb tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:10.791139 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 402/875] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:10 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1575 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:10.934500 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-e8b8178a-76b2-4bed-b333-0ec3d50a5bfb tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:10.942086 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-e8b8178a-76b2-4bed-b333-0ec3d50a5bfb tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1359 microversion: 2.1 time: 0.172743 Nov 20 03:30:10.942659 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 474/876] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:10 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:10.989859 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-17d8098e-424b-4b04-b325-7b38cea61b5f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:10.990543 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-17d8098e-424b-4b04-b325-7b38cea61b5f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:11.003893 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-17d8098e-424b-4b04-b325-7b38cea61b5f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:11.004504 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-17d8098e-424b-4b04-b325-7b38cea61b5f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:11.005549 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-17d8098e-424b-4b04-b325-7b38cea61b5f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:11.006336 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-17d8098e-424b-4b04-b325-7b38cea61b5f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:11.150384 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-17d8098e-424b-4b04-b325-7b38cea61b5f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:11.158488 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-17d8098e-424b-4b04-b325-7b38cea61b5f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:11.160234 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-17d8098e-424b-4b04-b325-7b38cea61b5f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:11.161386 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-17d8098e-424b-4b04-b325-7b38cea61b5f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1721 microversion: 2.20 time: 0.176167 Nov 20 03:30:11.179814 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 403/877] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:10 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:11.787159 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-d44d560e-419b-4383-800b-57e9fd823aef tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:11.792137 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-d44d560e-419b-4383-800b-57e9fd823aef tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:11.799559 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-6cc75ac5-a42d-41db-9459-86233ad7270a tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:11.800267 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-6cc75ac5-a42d-41db-9459-86233ad7270a tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:11.805593 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d44d560e-419b-4383-800b-57e9fd823aef tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:11.806050 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d44d560e-419b-4383-800b-57e9fd823aef tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:11.806854 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d44d560e-419b-4383-800b-57e9fd823aef tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:11.807298 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d44d560e-419b-4383-800b-57e9fd823aef tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:11.810906 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6cc75ac5-a42d-41db-9459-86233ad7270a tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:11.811745 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6cc75ac5-a42d-41db-9459-86233ad7270a tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:11.812841 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6cc75ac5-a42d-41db-9459-86233ad7270a tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:11.813308 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6cc75ac5-a42d-41db-9459-86233ad7270a tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:12.033713 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-6cc75ac5-a42d-41db-9459-86233ad7270a tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:12.042162 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-6cc75ac5-a42d-41db-9459-86233ad7270a tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1575 microversion: 2.1 time: 0.246261 Nov 20 03:30:12.042761 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 404/878] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:11 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1575 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:12.045055 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-d44d560e-419b-4383-800b-57e9fd823aef tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:12.047729 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-90a25f83-4ff8-4a27-ab8b-78a3c7190bc5 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:12.048377 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-90a25f83-4ff8-4a27-ab8b-78a3c7190bc5 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:12.055545 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-90a25f83-4ff8-4a27-ab8b-78a3c7190bc5 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:12.056026 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-90a25f83-4ff8-4a27-ab8b-78a3c7190bc5 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:12.056821 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-90a25f83-4ff8-4a27-ab8b-78a3c7190bc5 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:12.057254 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-90a25f83-4ff8-4a27-ab8b-78a3c7190bc5 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:12.065585 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-d44d560e-419b-4383-800b-57e9fd823aef tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1578 microversion: 2.1 time: 0.284895 Nov 20 03:30:12.071952 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 475/879] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:11 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1578 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:12.182178 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-2518baee-88ef-4ab4-a943-287d36a7c1f7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:12.182788 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-2518baee-88ef-4ab4-a943-287d36a7c1f7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:12.194385 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2518baee-88ef-4ab4-a943-287d36a7c1f7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:12.195916 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2518baee-88ef-4ab4-a943-287d36a7c1f7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:12.196824 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2518baee-88ef-4ab4-a943-287d36a7c1f7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:12.197335 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2518baee-88ef-4ab4-a943-287d36a7c1f7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:12.221658 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-90a25f83-4ff8-4a27-ab8b-78a3c7190bc5 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:12.230244 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-90a25f83-4ff8-4a27-ab8b-78a3c7190bc5 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1359 microversion: 2.1 time: 0.186442 Nov 20 03:30:12.231665 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 405/880] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:12 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:12.356061 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-2518baee-88ef-4ab4-a943-287d36a7c1f7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:12.365749 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-2518baee-88ef-4ab4-a943-287d36a7c1f7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:12.368979 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-2518baee-88ef-4ab4-a943-287d36a7c1f7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:12.370403 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-2518baee-88ef-4ab4-a943-287d36a7c1f7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1721 microversion: 2.20 time: 0.193966 Nov 20 03:30:12.381243 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 476/881] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:12 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:13.059888 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-1a98ef1c-f449-4125-8eb0-0274a62d10e7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:13.060538 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-1a98ef1c-f449-4125-8eb0-0274a62d10e7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:13.067125 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1a98ef1c-f449-4125-8eb0-0274a62d10e7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:13.067570 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1a98ef1c-f449-4125-8eb0-0274a62d10e7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:13.068360 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1a98ef1c-f449-4125-8eb0-0274a62d10e7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:13.068787 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1a98ef1c-f449-4125-8eb0-0274a62d10e7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:13.082832 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-9347f102-a69b-45e1-9b86-87c6d8279edb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:13.083444 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-9347f102-a69b-45e1-9b86-87c6d8279edb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:13.090318 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9347f102-a69b-45e1-9b86-87c6d8279edb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:13.090775 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9347f102-a69b-45e1-9b86-87c6d8279edb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:13.091557 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9347f102-a69b-45e1-9b86-87c6d8279edb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:13.092034 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9347f102-a69b-45e1-9b86-87c6d8279edb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:13.285136 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-1a98ef1c-f449-4125-8eb0-0274a62d10e7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:13.288137 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9347f102-a69b-45e1-9b86-87c6d8279edb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:13.293821 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-1a98ef1c-f449-4125-8eb0-0274a62d10e7 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1575 microversion: 2.1 time: 0.237589 Nov 20 03:30:13.294684 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 406/882] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:13 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1575 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:13.295717 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-9347f102-a69b-45e1-9b86-87c6d8279edb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1578 microversion: 2.1 time: 0.216436 Nov 20 03:30:13.300014 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-3329ca80-67d7-429f-984d-25c9525b5fdb tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:13.300902 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-3329ca80-67d7-429f-984d-25c9525b5fdb tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:13.307738 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3329ca80-67d7-429f-984d-25c9525b5fdb tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:13.308303 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3329ca80-67d7-429f-984d-25c9525b5fdb tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:13.309066 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 477/883] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:13 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1578 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:30:13.309220 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3329ca80-67d7-429f-984d-25c9525b5fdb tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:13.309788 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3329ca80-67d7-429f-984d-25c9525b5fdb tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:13.392951 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-a2103ba0-a209-417b-bd87-9da412dbb2b4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:13.393809 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-a2103ba0-a209-417b-bd87-9da412dbb2b4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:13.407114 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a2103ba0-a209-417b-bd87-9da412dbb2b4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:13.407566 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a2103ba0-a209-417b-bd87-9da412dbb2b4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:13.408390 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a2103ba0-a209-417b-bd87-9da412dbb2b4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:13.408829 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a2103ba0-a209-417b-bd87-9da412dbb2b4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:13.461025 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-3329ca80-67d7-429f-984d-25c9525b5fdb tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:13.468659 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-3329ca80-67d7-429f-984d-25c9525b5fdb tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1359 microversion: 2.1 time: 0.172636 Nov 20 03:30:13.469421 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 407/884] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:13 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:13.552063 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a2103ba0-a209-417b-bd87-9da412dbb2b4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:13.560390 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a2103ba0-a209-417b-bd87-9da412dbb2b4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:13.561909 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a2103ba0-a209-417b-bd87-9da412dbb2b4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:13.563050 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-a2103ba0-a209-417b-bd87-9da412dbb2b4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1721 microversion: 2.20 time: 0.173742 Nov 20 03:30:13.563596 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 478/885] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:13 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:30:14.312465 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-c2563920-65fd-4f3b-993a-90dc791b7720 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:14.313209 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-bcb16a6f-a218-426d-82ae-d829631bafa4 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:14.313610 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-bcb16a6f-a218-426d-82ae-d829631bafa4 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:14.314726 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-c2563920-65fd-4f3b-993a-90dc791b7720 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:14.319776 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bcb16a6f-a218-426d-82ae-d829631bafa4 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:14.320256 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bcb16a6f-a218-426d-82ae-d829631bafa4 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:14.321050 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bcb16a6f-a218-426d-82ae-d829631bafa4 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:14.321163 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c2563920-65fd-4f3b-993a-90dc791b7720 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:14.321487 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bcb16a6f-a218-426d-82ae-d829631bafa4 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:14.321614 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c2563920-65fd-4f3b-993a-90dc791b7720 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:14.322399 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c2563920-65fd-4f3b-993a-90dc791b7720 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:14.322839 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c2563920-65fd-4f3b-993a-90dc791b7720 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:14.524215 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-bcb16a6f-a218-426d-82ae-d829631bafa4 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:14.527705 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-c2563920-65fd-4f3b-993a-90dc791b7720 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:14.532062 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-bcb16a6f-a218-426d-82ae-d829631bafa4 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1578 microversion: 2.1 time: 0.223343 Nov 20 03:30:14.532635 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 408/886] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:14 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1578 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:14.535361 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-c2563920-65fd-4f3b-993a-90dc791b7720 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1575 microversion: 2.1 time: 0.226666 Nov 20 03:30:14.536066 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 479/887] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:14 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1575 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:14.537375 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-6eb8d8f1-53a8-4744-b84b-746015afc4ea tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:14.538148 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-6eb8d8f1-53a8-4744-b84b-746015afc4ea tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:14.545193 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6eb8d8f1-53a8-4744-b84b-746015afc4ea tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:14.546003 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6eb8d8f1-53a8-4744-b84b-746015afc4ea tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:14.546975 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6eb8d8f1-53a8-4744-b84b-746015afc4ea tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:14.547513 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6eb8d8f1-53a8-4744-b84b-746015afc4ea tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:14.581870 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-4df0a016-076d-463e-9fa9-300fa9b44673 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:14.582567 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-4df0a016-076d-463e-9fa9-300fa9b44673 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:14.588463 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4df0a016-076d-463e-9fa9-300fa9b44673 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:14.588909 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4df0a016-076d-463e-9fa9-300fa9b44673 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:14.589676 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4df0a016-076d-463e-9fa9-300fa9b44673 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:14.590108 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4df0a016-076d-463e-9fa9-300fa9b44673 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:14.715035 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-6eb8d8f1-53a8-4744-b84b-746015afc4ea tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:14.722648 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-6eb8d8f1-53a8-4744-b84b-746015afc4ea tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1359 microversion: 2.1 time: 0.189049 Nov 20 03:30:14.723218 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 409/888] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:14 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:14.759617 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-4df0a016-076d-463e-9fa9-300fa9b44673 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:14.767500 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-4df0a016-076d-463e-9fa9-300fa9b44673 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:14.769046 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-4df0a016-076d-463e-9fa9-300fa9b44673 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:14.770189 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-4df0a016-076d-463e-9fa9-300fa9b44673 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1721 microversion: 2.20 time: 0.191951 Nov 20 03:30:14.770747 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 480/889] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:14 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:30:15.549062 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-fd9b60ba-60f4-4130-b8f9-20194f818c0c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:15.549609 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-fd9b60ba-60f4-4130-b8f9-20194f818c0c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:15.552708 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-857e60eb-cb66-4ca2-9a52-c807a317b883 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:15.553354 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-857e60eb-cb66-4ca2-9a52-c807a317b883 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:15.557963 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fd9b60ba-60f4-4130-b8f9-20194f818c0c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:15.558422 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fd9b60ba-60f4-4130-b8f9-20194f818c0c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:15.559212 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fd9b60ba-60f4-4130-b8f9-20194f818c0c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:15.559649 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fd9b60ba-60f4-4130-b8f9-20194f818c0c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:15.561108 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-857e60eb-cb66-4ca2-9a52-c807a317b883 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:15.561566 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-857e60eb-cb66-4ca2-9a52-c807a317b883 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:15.562366 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-857e60eb-cb66-4ca2-9a52-c807a317b883 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:15.562795 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-857e60eb-cb66-4ca2-9a52-c807a317b883 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:15.872241 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-fd9b60ba-60f4-4130-b8f9-20194f818c0c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:15.882527 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-fd9b60ba-60f4-4130-b8f9-20194f818c0c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1578 microversion: 2.1 time: 0.337583 Nov 20 03:30:15.883345 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 410/890] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:15 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1578 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:30:15.887591 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-853a5eb4-2110-4b9d-9740-5ce84165c74d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:15.888156 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-853a5eb4-2110-4b9d-9740-5ce84165c74d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:15.891173 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-857e60eb-cb66-4ca2-9a52-c807a317b883 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:15.894291 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-853a5eb4-2110-4b9d-9740-5ce84165c74d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:15.894957 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-853a5eb4-2110-4b9d-9740-5ce84165c74d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:15.895755 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-853a5eb4-2110-4b9d-9740-5ce84165c74d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:15.896230 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-853a5eb4-2110-4b9d-9740-5ce84165c74d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:15.905097 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-857e60eb-cb66-4ca2-9a52-c807a317b883 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1575 microversion: 2.1 time: 0.355930 Nov 20 03:30:15.906689 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 481/891] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:15 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1575 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:30:15.913067 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-c875e6a2-0c40-41ca-b7b5-cb831527affe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:15.913960 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-c875e6a2-0c40-41ca-b7b5-cb831527affe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:15.921647 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c875e6a2-0c40-41ca-b7b5-cb831527affe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:15.922321 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c875e6a2-0c40-41ca-b7b5-cb831527affe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:15.923116 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c875e6a2-0c40-41ca-b7b5-cb831527affe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:15.923556 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c875e6a2-0c40-41ca-b7b5-cb831527affe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:16.200348 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-853a5eb4-2110-4b9d-9740-5ce84165c74d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:16.216292 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-853a5eb4-2110-4b9d-9740-5ce84165c74d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1359 microversion: 2.1 time: 0.331876 Nov 20 03:30:16.216810 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 411/892] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:15 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1359 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:16.234345 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-c875e6a2-0c40-41ca-b7b5-cb831527affe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:16.243433 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-c875e6a2-0c40-41ca-b7b5-cb831527affe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:16.245028 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-c875e6a2-0c40-41ca-b7b5-cb831527affe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:16.246248 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-c875e6a2-0c40-41ca-b7b5-cb831527affe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1721 microversion: 2.20 time: 0.337104 Nov 20 03:30:16.246802 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 482/893] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:15 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1721 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:16.350523 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-93696647-62a0-4912-903c-5273aa02ff6d req-e354d879-1723-4044-bc1a-2f01ba10c0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f80295e-5717-4a6a-8ee2-7c0d0d3ea879", "tag": "eb734ba7-0de6-4766-b88e-a690cb07fd57"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:30:16.352172 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:30:16.352172 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:30:16.359709 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-93696647-62a0-4912-903c-5273aa02ff6d req-e354d879-1723-4044-bc1a-2f01ba10c0a4 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:16.360274 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-93696647-62a0-4912-903c-5273aa02ff6d req-e354d879-1723-4044-bc1a-2f01ba10c0a4 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:16.377067 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-93696647-62a0-4912-903c-5273aa02ff6d req-e354d879-1723-4044-bc1a-2f01ba10c0a4 service nova] Creating event network-changed:eb734ba7-0de6-4766-b88e-a690cb07fd57 for instance 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 on hv-cinder-81803 Nov 20 03:30:16.382227 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-93696647-62a0-4912-903c-5273aa02ff6d req-e354d879-1723-4044-bc1a-2f01ba10c0a4 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035901 Nov 20 03:30:16.382827 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 412/894] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:30:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:30:16.899108 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-08bf7d21-7a22-4709-ae66-1326591e7a0f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:16.899730 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-08bf7d21-7a22-4709-ae66-1326591e7a0f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:16.906211 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-08bf7d21-7a22-4709-ae66-1326591e7a0f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:16.906667 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-08bf7d21-7a22-4709-ae66-1326591e7a0f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:16.907463 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-08bf7d21-7a22-4709-ae66-1326591e7a0f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:16.907930 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-08bf7d21-7a22-4709-ae66-1326591e7a0f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:16.924556 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-6ae3cf47-0164-42a8-955d-18b13a4569e1 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:16.925250 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-6ae3cf47-0164-42a8-955d-18b13a4569e1 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:16.931881 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6ae3cf47-0164-42a8-955d-18b13a4569e1 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:16.932570 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6ae3cf47-0164-42a8-955d-18b13a4569e1 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:16.933574 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6ae3cf47-0164-42a8-955d-18b13a4569e1 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:16.934011 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6ae3cf47-0164-42a8-955d-18b13a4569e1 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:17.188973 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-08bf7d21-7a22-4709-ae66-1326591e7a0f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:17.201583 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-08bf7d21-7a22-4709-ae66-1326591e7a0f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1578 microversion: 2.1 time: 0.306221 Nov 20 03:30:17.213580 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-6ae3cf47-0164-42a8-955d-18b13a4569e1 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:17.215155 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 483/895] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:16 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1578 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:17.222413 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-6ae3cf47-0164-42a8-955d-18b13a4569e1 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1575 microversion: 2.1 time: 0.300854 Nov 20 03:30:17.232398 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 413/896] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:16 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1575 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:30:17.233574 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-64646c84-32ac-480a-a6fa-b5e94b9fa442 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:17.233995 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-64646c84-32ac-480a-a6fa-b5e94b9fa442 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:17.244984 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-64646c84-32ac-480a-a6fa-b5e94b9fa442 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:17.245726 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-64646c84-32ac-480a-a6fa-b5e94b9fa442 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:17.247364 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-64646c84-32ac-480a-a6fa-b5e94b9fa442 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:17.247858 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-64646c84-32ac-480a-a6fa-b5e94b9fa442 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:17.265344 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-3e3416c7-f0c4-4aca-8485-e2300a2cb6d7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:17.265951 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-3e3416c7-f0c4-4aca-8485-e2300a2cb6d7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:17.272113 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3e3416c7-f0c4-4aca-8485-e2300a2cb6d7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:17.272555 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3e3416c7-f0c4-4aca-8485-e2300a2cb6d7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:17.273345 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3e3416c7-f0c4-4aca-8485-e2300a2cb6d7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:17.273775 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3e3416c7-f0c4-4aca-8485-e2300a2cb6d7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:17.556320 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-3e3416c7-f0c4-4aca-8485-e2300a2cb6d7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:17.559440 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-64646c84-32ac-480a-a6fa-b5e94b9fa442 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:17.566478 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-3e3416c7-f0c4-4aca-8485-e2300a2cb6d7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:17.567681 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-64646c84-32ac-480a-a6fa-b5e94b9fa442 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1359 microversion: 2.1 time: 0.338001 Nov 20 03:30:17.568874 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 484/897] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:17 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1359 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:30:17.569017 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-3e3416c7-f0c4-4aca-8485-e2300a2cb6d7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:17.571780 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-3e3416c7-f0c4-4aca-8485-e2300a2cb6d7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1742 microversion: 2.20 time: 0.309165 Nov 20 03:30:17.573336 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 414/898] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:17 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1742 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:30:18.218804 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-1b811340-b81a-44fd-afac-324eda53ae86 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:18.219425 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-1b811340-b81a-44fd-afac-324eda53ae86 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:18.226089 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1b811340-b81a-44fd-afac-324eda53ae86 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:18.226544 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1b811340-b81a-44fd-afac-324eda53ae86 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:18.227979 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1b811340-b81a-44fd-afac-324eda53ae86 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:18.228422 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1b811340-b81a-44fd-afac-324eda53ae86 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:18.240810 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-399e5f75-88d0-45fc-b429-1dc4ac327597 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:18.241414 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-399e5f75-88d0-45fc-b429-1dc4ac327597 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:18.247711 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-399e5f75-88d0-45fc-b429-1dc4ac327597 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:18.248181 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-399e5f75-88d0-45fc-b429-1dc4ac327597 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:18.248915 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-399e5f75-88d0-45fc-b429-1dc4ac327597 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:18.249346 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-399e5f75-88d0-45fc-b429-1dc4ac327597 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:18.426415 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-1b811340-b81a-44fd-afac-324eda53ae86 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:18.430237 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-399e5f75-88d0-45fc-b429-1dc4ac327597 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:18.434436 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-1b811340-b81a-44fd-afac-324eda53ae86 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1578 microversion: 2.1 time: 0.219242 Nov 20 03:30:18.435004 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 485/899] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:18 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1578 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:18.438075 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-399e5f75-88d0-45fc-b429-1dc4ac327597 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1562 microversion: 2.1 time: 0.200943 Nov 20 03:30:18.438645 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 415/900] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:18 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1562 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:30:18.591178 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-17f23da4-b754-4a16-8507-9d653a806dd9 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:18.591393 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-06b2597e-aeb7-4b0b-bb19-8096b595e079 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:18.591796 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-17f23da4-b754-4a16-8507-9d653a806dd9 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:18.591925 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-06b2597e-aeb7-4b0b-bb19-8096b595e079 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:18.598538 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-06b2597e-aeb7-4b0b-bb19-8096b595e079 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:18.599074 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-06b2597e-aeb7-4b0b-bb19-8096b595e079 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:18.599681 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-17f23da4-b754-4a16-8507-9d653a806dd9 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:18.600126 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-06b2597e-aeb7-4b0b-bb19-8096b595e079 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:18.600229 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-17f23da4-b754-4a16-8507-9d653a806dd9 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:18.600690 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-06b2597e-aeb7-4b0b-bb19-8096b595e079 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:18.600910 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-17f23da4-b754-4a16-8507-9d653a806dd9 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:18.601340 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-17f23da4-b754-4a16-8507-9d653a806dd9 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:18.795032 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-17f23da4-b754-4a16-8507-9d653a806dd9 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:18.799288 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-06b2597e-aeb7-4b0b-bb19-8096b595e079 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:18.802373 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-17f23da4-b754-4a16-8507-9d653a806dd9 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1359 microversion: 2.1 time: 0.214782 Nov 20 03:30:18.802949 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 416/901] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:18 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:30:18.807214 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-06b2597e-aeb7-4b0b-bb19-8096b595e079 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:18.808831 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-06b2597e-aeb7-4b0b-bb19-8096b595e079 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:18.810055 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-06b2597e-aeb7-4b0b-bb19-8096b595e079 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1742 microversion: 2.20 time: 0.222541 Nov 20 03:30:18.810791 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 486/902] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:18 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1742 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:30:19.450906 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-d497fd26-fe20-4a3e-a1bc-f549baba637b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:19.451519 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-d497fd26-fe20-4a3e-a1bc-f549baba637b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:19.457804 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d497fd26-fe20-4a3e-a1bc-f549baba637b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:19.458249 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d497fd26-fe20-4a3e-a1bc-f549baba637b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:19.459024 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d497fd26-fe20-4a3e-a1bc-f549baba637b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:19.459460 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d497fd26-fe20-4a3e-a1bc-f549baba637b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:19.594736 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-d497fd26-fe20-4a3e-a1bc-f549baba637b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:19.602776 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-d497fd26-fe20-4a3e-a1bc-f549baba637b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1578 microversion: 2.1 time: 0.155626 Nov 20 03:30:19.603345 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 417/903] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:19 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:19.818831 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-7bbc3b64-dd9d-4f9b-a21d-2c13ed15220a tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:19.819410 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-7bbc3b64-dd9d-4f9b-a21d-2c13ed15220a tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:19.826031 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7bbc3b64-dd9d-4f9b-a21d-2c13ed15220a tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:19.826481 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7bbc3b64-dd9d-4f9b-a21d-2c13ed15220a tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:19.827256 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7bbc3b64-dd9d-4f9b-a21d-2c13ed15220a tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:19.827690 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7bbc3b64-dd9d-4f9b-a21d-2c13ed15220a tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:19.828222 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-d637698b-a38b-45a1-860c-43178de5f450 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:19.829415 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-d637698b-a38b-45a1-860c-43178de5f450 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:19.835213 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d637698b-a38b-45a1-860c-43178de5f450 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:19.835659 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d637698b-a38b-45a1-860c-43178de5f450 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:19.836482 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d637698b-a38b-45a1-860c-43178de5f450 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:19.836922 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d637698b-a38b-45a1-860c-43178de5f450 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:20.270385 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-d637698b-a38b-45a1-860c-43178de5f450 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:20.275603 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-7bbc3b64-dd9d-4f9b-a21d-2c13ed15220a tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:20.279126 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-d637698b-a38b-45a1-860c-43178de5f450 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:20.280679 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-d637698b-a38b-45a1-860c-43178de5f450 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:20.281824 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-d637698b-a38b-45a1-860c-43178de5f450 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1742 microversion: 2.20 time: 0.457277 Nov 20 03:30:20.282619 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 418/904] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:19 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1742 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:30:20.282862 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-7bbc3b64-dd9d-4f9b-a21d-2c13ed15220a tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1359 microversion: 2.1 time: 0.467670 Nov 20 03:30:20.283576 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 487/905] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:19 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1359 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:20.492268 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-8c3b70cf-c9c3-4fff-9907-17f2d49947d8 req-64eb3edd-fa5e-4184-9824-c60e4cfb48f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea9197b-774d-4dc7-9461-3a5ab4e5e7a0", "name": "network-vif-plugged", "status": "completed", "tag": "09e4f458-7d7a-4be0-87eb-4f821050a3c3"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:30:20.493869 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:30:20.493869 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:30:20.503414 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-8c3b70cf-c9c3-4fff-9907-17f2d49947d8 req-64eb3edd-fa5e-4184-9824-c60e4cfb48f6 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:20.503904 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-8c3b70cf-c9c3-4fff-9907-17f2d49947d8 req-64eb3edd-fa5e-4184-9824-c60e4cfb48f6 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:20.515277 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-8c3b70cf-c9c3-4fff-9907-17f2d49947d8 req-64eb3edd-fa5e-4184-9824-c60e4cfb48f6 service nova] Creating event network-vif-plugged:09e4f458-7d7a-4be0-87eb-4f821050a3c3 for instance eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 on hv-cinder-81803 Nov 20 03:30:20.520236 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-8c3b70cf-c9c3-4fff-9907-17f2d49947d8 req-64eb3edd-fa5e-4184-9824-c60e4cfb48f6 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031610 Nov 20 03:30:20.520821 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 419/906] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:30:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:30:20.619502 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-e9e3764a-ef43-4984-8cd1-cc33b8d72cf1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:20.620145 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-e9e3764a-ef43-4984-8cd1-cc33b8d72cf1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:20.626013 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e9e3764a-ef43-4984-8cd1-cc33b8d72cf1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:20.626492 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e9e3764a-ef43-4984-8cd1-cc33b8d72cf1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:20.627255 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e9e3764a-ef43-4984-8cd1-cc33b8d72cf1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:20.627700 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e9e3764a-ef43-4984-8cd1-cc33b8d72cf1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:20.762433 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-e9e3764a-ef43-4984-8cd1-cc33b8d72cf1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:20.770007 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-e9e3764a-ef43-4984-8cd1-cc33b8d72cf1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1578 microversion: 2.1 time: 0.154120 Nov 20 03:30:20.770560 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 488/907] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:20 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:30:21.302045 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-8820d3a9-0522-4f95-bae7-faf7e8c0ac3a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:21.303170 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-8820d3a9-0522-4f95-bae7-faf7e8c0ac3a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:21.303433 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-24ec6728-d913-4d64-afff-667ca74169fd tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:21.304087 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-24ec6728-d913-4d64-afff-667ca74169fd tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:21.310003 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8820d3a9-0522-4f95-bae7-faf7e8c0ac3a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:21.310457 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8820d3a9-0522-4f95-bae7-faf7e8c0ac3a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:21.310763 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-24ec6728-d913-4d64-afff-667ca74169fd tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:21.311211 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-24ec6728-d913-4d64-afff-667ca74169fd tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:21.311327 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8820d3a9-0522-4f95-bae7-faf7e8c0ac3a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:21.311672 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8820d3a9-0522-4f95-bae7-faf7e8c0ac3a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:21.312013 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-24ec6728-d913-4d64-afff-667ca74169fd tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:21.312451 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-24ec6728-d913-4d64-afff-667ca74169fd tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:21.497202 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-24ec6728-d913-4d64-afff-667ca74169fd tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:21.504457 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-24ec6728-d913-4d64-afff-667ca74169fd tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1359 microversion: 2.1 time: 0.204579 Nov 20 03:30:21.505642 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 489/908] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:21 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1359 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:30:21.508043 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-8820d3a9-0522-4f95-bae7-faf7e8c0ac3a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:21.515774 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-8820d3a9-0522-4f95-bae7-faf7e8c0ac3a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:21.517332 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-8820d3a9-0522-4f95-bae7-faf7e8c0ac3a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:21.518474 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-8820d3a9-0522-4f95-bae7-faf7e8c0ac3a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1742 microversion: 2.20 time: 0.221406 Nov 20 03:30:21.519022 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 420/909] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:21 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1742 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:21.786942 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-b814611a-24e8-4098-a272-34da72730c27 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:21.787549 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-b814611a-24e8-4098-a272-34da72730c27 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:21.794266 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b814611a-24e8-4098-a272-34da72730c27 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:21.794723 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b814611a-24e8-4098-a272-34da72730c27 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:21.795511 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b814611a-24e8-4098-a272-34da72730c27 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:21.796267 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b814611a-24e8-4098-a272-34da72730c27 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:21.953285 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-b814611a-24e8-4098-a272-34da72730c27 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:21.961160 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-b814611a-24e8-4098-a272-34da72730c27 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1578 microversion: 2.1 time: 0.177689 Nov 20 03:30:21.962432 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 490/910] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:21 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1578 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:22.521454 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-cdbc4ca1-ee85-4daf-ae8a-430cc3abd09d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:22.522860 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-cdbc4ca1-ee85-4daf-ae8a-430cc3abd09d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:22.531022 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cdbc4ca1-ee85-4daf-ae8a-430cc3abd09d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:22.532025 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cdbc4ca1-ee85-4daf-ae8a-430cc3abd09d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:22.533561 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cdbc4ca1-ee85-4daf-ae8a-430cc3abd09d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:22.534517 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cdbc4ca1-ee85-4daf-ae8a-430cc3abd09d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:22.536272 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-25381052-9177-4642-a222-b68c8949e050 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:22.536881 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-25381052-9177-4642-a222-b68c8949e050 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:22.545298 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-25381052-9177-4642-a222-b68c8949e050 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:22.546015 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-25381052-9177-4642-a222-b68c8949e050 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:22.546965 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-25381052-9177-4642-a222-b68c8949e050 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:22.547554 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-25381052-9177-4642-a222-b68c8949e050 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:22.971422 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-cdbc4ca1-ee85-4daf-ae8a-430cc3abd09d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:22.983189 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-cdbc4ca1-ee85-4daf-ae8a-430cc3abd09d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1359 microversion: 2.1 time: 0.466220 Nov 20 03:30:22.986681 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 421/911] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:22 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1359 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:22.991086 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-3bdc1727-f67b-4067-8a3a-750ba7595041 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:22.998525 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-3bdc1727-f67b-4067-8a3a-750ba7595041 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:23.014970 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3bdc1727-f67b-4067-8a3a-750ba7595041 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:23.016662 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3bdc1727-f67b-4067-8a3a-750ba7595041 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:23.017737 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3bdc1727-f67b-4067-8a3a-750ba7595041 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:23.018567 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-25381052-9177-4642-a222-b68c8949e050 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:23.022683 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3bdc1727-f67b-4067-8a3a-750ba7595041 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:23.037475 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-25381052-9177-4642-a222-b68c8949e050 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:23.039892 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-25381052-9177-4642-a222-b68c8949e050 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:23.042171 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-25381052-9177-4642-a222-b68c8949e050 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1737 microversion: 2.20 time: 0.509448 Nov 20 03:30:23.043129 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 491/912] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:22 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1737 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:30:23.126767 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-3bdc1727-f67b-4067-8a3a-750ba7595041 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:23.135439 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-3bdc1727-f67b-4067-8a3a-750ba7595041 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1510 microversion: 2.1 time: 0.147676 Nov 20 03:30:23.146969 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 422/913] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:22 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:23.407835 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-22a08522-78bc-4335-8699-9c8b9078681a req-6aa6baba-8dac-4ed3-8c31-363a40ad6d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f64dd34e-277a-4033-8330-d0dd481d287c", "name": "network-vif-deleted", "tag": "243add17-6449-4a77-8663-2a184bd82457"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:30:23.410231 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:30:23.410231 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:30:23.420007 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-22a08522-78bc-4335-8699-9c8b9078681a req-6aa6baba-8dac-4ed3-8c31-363a40ad6d6f service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:23.420772 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-22a08522-78bc-4335-8699-9c8b9078681a req-6aa6baba-8dac-4ed3-8c31-363a40ad6d6f service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:23.449447 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-22a08522-78bc-4335-8699-9c8b9078681a req-6aa6baba-8dac-4ed3-8c31-363a40ad6d6f service nova] Creating event network-vif-deleted:243add17-6449-4a77-8663-2a184bd82457 for instance f64dd34e-277a-4033-8330-d0dd481d287c on hv-cinder-81803 Nov 20 03:30:23.455932 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-22a08522-78bc-4335-8699-9c8b9078681a req-6aa6baba-8dac-4ed3-8c31-363a40ad6d6f service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051859 Nov 20 03:30:23.456735 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 492/914] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:30:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:30:24.002345 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-ab4249c3-c261-46ff-a277-204035383702 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:24.002965 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-ab4249c3-c261-46ff-a277-204035383702 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:24.026542 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ab4249c3-c261-46ff-a277-204035383702 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:24.028989 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ab4249c3-c261-46ff-a277-204035383702 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:24.029987 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ab4249c3-c261-46ff-a277-204035383702 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:24.030591 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ab4249c3-c261-46ff-a277-204035383702 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:24.062169 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-849762f6-3aff-4a8e-9124-744eafd21b26 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:24.062854 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-849762f6-3aff-4a8e-9124-744eafd21b26 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:24.076312 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-849762f6-3aff-4a8e-9124-744eafd21b26 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:24.076769 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-849762f6-3aff-4a8e-9124-744eafd21b26 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:24.077574 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-849762f6-3aff-4a8e-9124-744eafd21b26 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:24.078011 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-849762f6-3aff-4a8e-9124-744eafd21b26 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:24.217257 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-ab4249c3-c261-46ff-a277-204035383702 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:24.225419 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-ab4249c3-c261-46ff-a277-204035383702 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1359 microversion: 2.1 time: 0.226596 Nov 20 03:30:24.239675 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 423/915] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:23 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:24.245094 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-93d3bb9f-e209-439f-a0f2-9a3b42856954 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:24.246975 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-93d3bb9f-e209-439f-a0f2-9a3b42856954 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:24.258853 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-93d3bb9f-e209-439f-a0f2-9a3b42856954 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:24.261962 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-93d3bb9f-e209-439f-a0f2-9a3b42856954 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:24.262985 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-93d3bb9f-e209-439f-a0f2-9a3b42856954 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:24.268391 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-93d3bb9f-e209-439f-a0f2-9a3b42856954 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:24.455355 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-93d3bb9f-e209-439f-a0f2-9a3b42856954 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:24.469958 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-849762f6-3aff-4a8e-9124-744eafd21b26 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:24.487250 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-849762f6-3aff-4a8e-9124-744eafd21b26 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:24.489063 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-849762f6-3aff-4a8e-9124-744eafd21b26 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:24.490055 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-849762f6-3aff-4a8e-9124-744eafd21b26 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1737 microversion: 2.20 time: 0.432310 Nov 20 03:30:24.490613 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 493/916] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:24 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1737 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:24.496640 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-93d3bb9f-e209-439f-a0f2-9a3b42856954 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1510 microversion: 2.1 time: 0.252519 Nov 20 03:30:24.499993 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 424/917] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:24 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1510 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:25.250243 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-c27054c5-9eae-4077-ba13-b7a17646c405 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:25.250819 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-c27054c5-9eae-4077-ba13-b7a17646c405 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:25.264252 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c27054c5-9eae-4077-ba13-b7a17646c405 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:25.265232 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c27054c5-9eae-4077-ba13-b7a17646c405 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:25.268158 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c27054c5-9eae-4077-ba13-b7a17646c405 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:25.268846 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c27054c5-9eae-4077-ba13-b7a17646c405 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:25.421211 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-c27054c5-9eae-4077-ba13-b7a17646c405 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:25.431408 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-c27054c5-9eae-4077-ba13-b7a17646c405 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1359 microversion: 2.1 time: 0.188482 Nov 20 03:30:25.432348 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 494/918] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:25 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:25.508912 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-7560f931-0b4c-468a-9569-e9139dca67ff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:25.509514 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-7560f931-0b4c-468a-9569-e9139dca67ff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:25.515922 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7560f931-0b4c-468a-9569-e9139dca67ff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:25.516373 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7560f931-0b4c-468a-9569-e9139dca67ff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:25.517151 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7560f931-0b4c-468a-9569-e9139dca67ff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:25.517582 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7560f931-0b4c-468a-9569-e9139dca67ff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:25.518870 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-5d817887-2a94-47cd-928a-0bef5c2ec4e7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:25.519722 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-5d817887-2a94-47cd-928a-0bef5c2ec4e7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:25.529038 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5d817887-2a94-47cd-928a-0bef5c2ec4e7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:25.529877 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5d817887-2a94-47cd-928a-0bef5c2ec4e7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:25.531131 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5d817887-2a94-47cd-928a-0bef5c2ec4e7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:25.531816 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5d817887-2a94-47cd-928a-0bef5c2ec4e7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:25.623457 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-5d817887-2a94-47cd-928a-0bef5c2ec4e7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:25.632203 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-5d817887-2a94-47cd-928a-0bef5c2ec4e7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1225 microversion: 2.1 time: 0.117132 Nov 20 03:30:25.639490 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 495/919] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:25 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1225 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:30:25.712868 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-7560f931-0b4c-468a-9569-e9139dca67ff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:25.721513 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-7560f931-0b4c-468a-9569-e9139dca67ff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:25.723100 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-7560f931-0b4c-468a-9569-e9139dca67ff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:25.724370 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-7560f931-0b4c-468a-9569-e9139dca67ff tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1737 microversion: 2.20 time: 0.219387 Nov 20 03:30:25.725006 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 425/920] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:25 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:26.448271 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-0a4c7e41-f30f-4ebd-a545-54b9fbf973eb tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:26.449206 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-0a4c7e41-f30f-4ebd-a545-54b9fbf973eb tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:26.455324 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0a4c7e41-f30f-4ebd-a545-54b9fbf973eb tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:26.455898 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0a4c7e41-f30f-4ebd-a545-54b9fbf973eb tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:26.457070 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0a4c7e41-f30f-4ebd-a545-54b9fbf973eb tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:26.457734 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0a4c7e41-f30f-4ebd-a545-54b9fbf973eb tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:26.620232 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-0a4c7e41-f30f-4ebd-a545-54b9fbf973eb tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:26.628475 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-0a4c7e41-f30f-4ebd-a545-54b9fbf973eb tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1359 microversion: 2.1 time: 0.183725 Nov 20 03:30:26.629449 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 496/921] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:26 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:26.654120 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-fe32ec08-d0dc-40ef-93b2-39e58c8f3d53 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:26.655386 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-fe32ec08-d0dc-40ef-93b2-39e58c8f3d53 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:26.663064 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fe32ec08-d0dc-40ef-93b2-39e58c8f3d53 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:26.663815 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fe32ec08-d0dc-40ef-93b2-39e58c8f3d53 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:26.664630 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fe32ec08-d0dc-40ef-93b2-39e58c8f3d53 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:26.665058 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fe32ec08-d0dc-40ef-93b2-39e58c8f3d53 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:26.699808 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fe32ec08-d0dc-40ef-93b2-39e58c8f3d53 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:26.700623 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fe32ec08-d0dc-40ef-93b2-39e58c8f3d53 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:26.701151 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.objects.instance [None req-fe32ec08-d0dc-40ef-93b2-39e58c8f3d53 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lazy-loading 'fault' on Instance uuid f64dd34e-277a-4033-8330-d0dd481d287c {{(pid=116114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 03:30:26.745831 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-16e2815d-dc8c-4dca-bcae-3330f5c8f1a4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:26.746737 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-16e2815d-dc8c-4dca-bcae-3330f5c8f1a4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:26.755588 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-16e2815d-dc8c-4dca-bcae-3330f5c8f1a4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:26.756478 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-fe32ec08-d0dc-40ef-93b2-39e58c8f3d53 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:26.762623 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-16e2815d-dc8c-4dca-bcae-3330f5c8f1a4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:26.763475 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-16e2815d-dc8c-4dca-bcae-3330f5c8f1a4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:26.763952 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-16e2815d-dc8c-4dca-bcae-3330f5c8f1a4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:26.767478 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-fe32ec08-d0dc-40ef-93b2-39e58c8f3d53 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 200 len: 1230 microversion: 2.1 time: 0.121718 Nov 20 03:30:26.769460 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 426/922] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:26 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 1230 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:26.950394 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-16e2815d-dc8c-4dca-bcae-3330f5c8f1a4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:26.960891 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-16e2815d-dc8c-4dca-bcae-3330f5c8f1a4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:26.962422 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-16e2815d-dc8c-4dca-bcae-3330f5c8f1a4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:26.963703 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-16e2815d-dc8c-4dca-bcae-3330f5c8f1a4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1737 microversion: 2.20 time: 0.221653 Nov 20 03:30:26.964305 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 497/923] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:26 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1737 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:27.644889 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-5ad87a91-06e7-41fd-9285-06cda0d98924 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:27.645928 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-5ad87a91-06e7-41fd-9285-06cda0d98924 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:27.652439 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5ad87a91-06e7-41fd-9285-06cda0d98924 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:27.652968 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5ad87a91-06e7-41fd-9285-06cda0d98924 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:27.654025 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5ad87a91-06e7-41fd-9285-06cda0d98924 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:27.654550 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5ad87a91-06e7-41fd-9285-06cda0d98924 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:27.787538 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-7084feb0-1861-44a6-ba26-ff8f2f41daa1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:27.790190 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-7084feb0-1861-44a6-ba26-ff8f2f41daa1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:27.795817 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-5ad87a91-06e7-41fd-9285-06cda0d98924 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:27.803544 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-5ad87a91-06e7-41fd-9285-06cda0d98924 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1359 microversion: 2.1 time: 0.162346 Nov 20 03:30:27.804201 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7084feb0-1861-44a6-ba26-ff8f2f41daa1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:27.804502 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 427/924] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:27 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:27.805224 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7084feb0-1861-44a6-ba26-ff8f2f41daa1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:27.806029 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7084feb0-1861-44a6-ba26-ff8f2f41daa1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:27.806469 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7084feb0-1861-44a6-ba26-ff8f2f41daa1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:27.823439 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.wsgi [None req-7084feb0-1861-44a6-ba26-ff8f2f41daa1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] HTTP exception thrown: Instance f64dd34e-277a-4033-8330-d0dd481d287c could not be found. Nov 20 03:30:27.824678 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-7084feb0-1861-44a6-ba26-ff8f2f41daa1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Returning 404 to user: Instance f64dd34e-277a-4033-8330-d0dd481d287c could not be found. {{(pid=116113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:30:27.825777 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-7084feb0-1861-44a6-ba26-ff8f2f41daa1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 404 len: 111 microversion: 2.1 time: 0.043204 Nov 20 03:30:27.827828 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 498/925] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:27 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:30:27.930945 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-a7cfbec6-8b28-4ad7-b5cd-01b7135d803b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1853603746", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2111923564", "security_groups": [{"name": "tempest-secgroup-smoke-1311371933"}], "block_device_mapping_v2": [{"uuid": "fad1466b-e92d-4e67-9883-ef8d80041feb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "47f51dd2-9655-4765-8747-cb254c8e5525"}]}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:30:27.982662 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-95b541f2-6078-4f32-ba24-1eca94ed11e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:27.983280 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-95b541f2-6078-4f32-ba24-1eca94ed11e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:27.989243 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-95b541f2-6078-4f32-ba24-1eca94ed11e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:27.989891 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-95b541f2-6078-4f32-ba24-1eca94ed11e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:27.990843 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-95b541f2-6078-4f32-ba24-1eca94ed11e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:27.991271 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-95b541f2-6078-4f32-ba24-1eca94ed11e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:28.110271 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.network.neutron [None req-a7cfbec6-8b28-4ad7-b5cd-01b7135d803b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] validate_networks() for [('47f51dd2-9655-4765-8747-cb254c8e5525', None, None, None, None, None)] {{(pid=116114) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 03:30:28.275566 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-95b541f2-6078-4f32-ba24-1eca94ed11e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:28.290639 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-95b541f2-6078-4f32-ba24-1eca94ed11e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:28.301186 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-95b541f2-6078-4f32-ba24-1eca94ed11e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:28.302496 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-95b541f2-6078-4f32-ba24-1eca94ed11e4 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1737 microversion: 2.20 time: 0.323432 Nov 20 03:30:28.314515 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 499/926] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:27 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1737 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:28.355382 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-3556e72a-a929-485a-bad4-6ea6abcc5caf req-fd99d866-b6d6-4a63-af8a-e25c3d4880a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f80295e-5717-4a6a-8ee2-7c0d0d3ea879", "name": "network-vif-plugged", "status": "completed", "tag": "eb734ba7-0de6-4766-b88e-a690cb07fd57"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:30:28.360107 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:30:28.360107 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:30:28.375979 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-3556e72a-a929-485a-bad4-6ea6abcc5caf req-fd99d866-b6d6-4a63-af8a-e25c3d4880a6 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:28.383521 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-3556e72a-a929-485a-bad4-6ea6abcc5caf req-fd99d866-b6d6-4a63-af8a-e25c3d4880a6 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:28.420351 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-3556e72a-a929-485a-bad4-6ea6abcc5caf req-fd99d866-b6d6-4a63-af8a-e25c3d4880a6 service nova] Creating event network-vif-plugged:eb734ba7-0de6-4766-b88e-a690cb07fd57 for instance 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 on hv-cinder-81803 Nov 20 03:30:28.431883 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-3556e72a-a929-485a-bad4-6ea6abcc5caf req-fd99d866-b6d6-4a63-af8a-e25c3d4880a6 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088449 Nov 20 03:30:28.432494 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 500/927] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:30:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:30:28.737963 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-a7cfbec6-8b28-4ad7-b5cd-01b7135d803b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Flavor limits 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 03:30:28.738511 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-a7cfbec6-8b28-4ad7-b5cd-01b7135d803b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Image limits 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 03:30:28.738909 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-a7cfbec6-8b28-4ad7-b5cd-01b7135d803b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Flavor pref 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 03:30:28.739755 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-a7cfbec6-8b28-4ad7-b5cd-01b7135d803b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Image pref 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 03:30:28.740476 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-a7cfbec6-8b28-4ad7-b5cd-01b7135d803b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 03:30:28.765151 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a7cfbec6-8b28-4ad7-b5cd-01b7135d803b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:28.765675 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a7cfbec6-8b28-4ad7-b5cd-01b7135d803b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:28.767960 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a7cfbec6-8b28-4ad7-b5cd-01b7135d803b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:28.768483 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a7cfbec6-8b28-4ad7-b5cd-01b7135d803b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:28.785432 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-a7cfbec6-8b28-4ad7-b5cd-01b7135d803b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Getting quotas for project ee28f54d912d4789b1b0abf0f0cddab5. Resources: {'ram', 'cores', 'instances'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:30:28.789924 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-a7cfbec6-8b28-4ad7-b5cd-01b7135d803b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Getting quotas for user 2841384d235c4869bc6c39212c34f0f9 and project ee28f54d912d4789b1b0abf0f0cddab5. Resources: {'ram', 'cores', 'instances'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:30:28.822072 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-7948437f-360d-46d9-9cd0-71c83becfc84 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:28.822872 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-7948437f-360d-46d9-9cd0-71c83becfc84 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:28.830262 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7948437f-360d-46d9-9cd0-71c83becfc84 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:28.831026 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7948437f-360d-46d9-9cd0-71c83becfc84 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:28.832081 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7948437f-360d-46d9-9cd0-71c83becfc84 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:28.832798 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7948437f-360d-46d9-9cd0-71c83becfc84 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:28.875649 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-a7cfbec6-8b28-4ad7-b5cd-01b7135d803b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Going to run 1 instances... {{(pid=116114) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 03:30:28.877844 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-a7cfbec6-8b28-4ad7-b5cd-01b7135d803b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fad1466b-e92d-4e67-9883-ef8d80041feb',volume_size=None,volume_type=None)] {{(pid=116114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 03:30:29.012197 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-7948437f-360d-46d9-9cd0-71c83becfc84 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:29.021227 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-7948437f-360d-46d9-9cd0-71c83becfc84 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1359 microversion: 2.1 time: 0.203888 Nov 20 03:30:29.022160 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 501/928] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:28 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1359 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:29.060438 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-a7cfbec6-8b28-4ad7-b5cd-01b7135d803b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.134200 Nov 20 03:30:29.061285 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 428/929] 10.222.0.37 () {60 vars in 1146 bytes} [Sat Nov 20 03:30:27 2021] POST /compute/v2.1/servers => generated 406 bytes in 1135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 03:30:29.071726 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-581c4764-1f95-43b8-bf04-c61a8cc06f95 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:29.073465 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-581c4764-1f95-43b8-bf04-c61a8cc06f95 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:29.136690 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-581c4764-1f95-43b8-bf04-c61a8cc06f95 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:29.144429 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-581c4764-1f95-43b8-bf04-c61a8cc06f95 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1095 microversion: 2.1 time: 0.076740 Nov 20 03:30:29.151957 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 502/930] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:29 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:29.322379 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-d62ce594-4d21-406c-866e-de3942554bbe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:29.323506 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-d62ce594-4d21-406c-866e-de3942554bbe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:29.333405 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d62ce594-4d21-406c-866e-de3942554bbe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:29.334384 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d62ce594-4d21-406c-866e-de3942554bbe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:29.335768 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d62ce594-4d21-406c-866e-de3942554bbe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:29.336967 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d62ce594-4d21-406c-866e-de3942554bbe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:29.519469 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-d62ce594-4d21-406c-866e-de3942554bbe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:29.530550 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-d62ce594-4d21-406c-866e-de3942554bbe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:29.532095 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-d62ce594-4d21-406c-866e-de3942554bbe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:29.533445 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-d62ce594-4d21-406c-866e-de3942554bbe tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1737 microversion: 2.20 time: 0.215377 Nov 20 03:30:29.534033 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 429/931] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:29 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:30.038245 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-e659cae2-b9fd-4cf3-92d6-56ac7970b114 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:30.039555 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-e659cae2-b9fd-4cf3-92d6-56ac7970b114 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:30.048285 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e659cae2-b9fd-4cf3-92d6-56ac7970b114 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:30.048984 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e659cae2-b9fd-4cf3-92d6-56ac7970b114 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:30.049950 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e659cae2-b9fd-4cf3-92d6-56ac7970b114 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:30.050551 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e659cae2-b9fd-4cf3-92d6-56ac7970b114 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:30.161803 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-572c7659-1ec2-4fda-9273-9a1779ebe339 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:30.162313 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-572c7659-1ec2-4fda-9273-9a1779ebe339 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:30.168766 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-572c7659-1ec2-4fda-9273-9a1779ebe339 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:30.169225 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-572c7659-1ec2-4fda-9273-9a1779ebe339 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:30.170014 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-572c7659-1ec2-4fda-9273-9a1779ebe339 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:30.170450 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-572c7659-1ec2-4fda-9273-9a1779ebe339 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:30.215818 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-e659cae2-b9fd-4cf3-92d6-56ac7970b114 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:30.224412 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-e659cae2-b9fd-4cf3-92d6-56ac7970b114 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1359 microversion: 2.1 time: 0.189358 Nov 20 03:30:30.225309 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 503/932] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:30 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:30.271646 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-572c7659-1ec2-4fda-9273-9a1779ebe339 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:30.281815 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-572c7659-1ec2-4fda-9273-9a1779ebe339 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1193 microversion: 2.1 time: 0.123282 Nov 20 03:30:30.291892 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 430/933] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:30 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1193 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:30.551243 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-2653c6c7-95cc-4bad-81a2-5d13052b7f48 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:30.551746 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-2653c6c7-95cc-4bad-81a2-5d13052b7f48 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: 51fdb082-29f4-42ab-96d3-86dcfd59910c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:30.557180 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-3d0be0dc-9b47-4af7-8170-7209212ee467 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:30.557797 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-3d0be0dc-9b47-4af7-8170-7209212ee467 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:30.563867 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2653c6c7-95cc-4bad-81a2-5d13052b7f48 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:30.568478 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3d0be0dc-9b47-4af7-8170-7209212ee467 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:30.569232 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2653c6c7-95cc-4bad-81a2-5d13052b7f48 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:30.570281 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2653c6c7-95cc-4bad-81a2-5d13052b7f48 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:30.570961 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2653c6c7-95cc-4bad-81a2-5d13052b7f48 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:30.571586 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3d0be0dc-9b47-4af7-8170-7209212ee467 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:30.573667 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3d0be0dc-9b47-4af7-8170-7209212ee467 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:30.574338 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3d0be0dc-9b47-4af7-8170-7209212ee467 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:30.730931 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.objects.instance [None req-2653c6c7-95cc-4bad-81a2-5d13052b7f48 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lazy-loading 'services' on Instance uuid 51fdb082-29f4-42ab-96d3-86dcfd59910c {{(pid=116113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 03:30:30.823241 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-2653c6c7-95cc-4bad-81a2-5d13052b7f48 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "DELETE /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c/os-volume_attachments/1300d7e0-2abd-4911-bec1-41cd1e02369f" status: 202 len: 0 microversion: 2.1 time: 0.275179 Nov 20 03:30:30.829173 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 504/934] 10.222.0.37 () {58 vars in 1415 bytes} [Sat Nov 20 03:30:30 2021] DELETE /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c/os-volume_attachments/1300d7e0-2abd-4911-bec1-41cd1e02369f => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:30:30.852129 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-3d0be0dc-9b47-4af7-8170-7209212ee467 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:30.864957 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-3d0be0dc-9b47-4af7-8170-7209212ee467 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:30.869987 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-3d0be0dc-9b47-4af7-8170-7209212ee467 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:30.871479 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-3d0be0dc-9b47-4af7-8170-7209212ee467 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1737 microversion: 2.20 time: 0.318531 Nov 20 03:30:30.875272 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 431/935] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:30 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1737 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:31.242178 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-865eda4e-f6dc-4915-bffe-b7123040cec8 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:31.242777 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-865eda4e-f6dc-4915-bffe-b7123040cec8 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:31.254180 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-865eda4e-f6dc-4915-bffe-b7123040cec8 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:31.254820 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-865eda4e-f6dc-4915-bffe-b7123040cec8 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:31.255514 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-865eda4e-f6dc-4915-bffe-b7123040cec8 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:31.259195 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-865eda4e-f6dc-4915-bffe-b7123040cec8 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:31.302316 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-f1f23b6b-2271-4ea0-ae42-5e1323afdbc7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:31.302927 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-f1f23b6b-2271-4ea0-ae42-5e1323afdbc7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:31.309792 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f1f23b6b-2271-4ea0-ae42-5e1323afdbc7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:31.311436 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f1f23b6b-2271-4ea0-ae42-5e1323afdbc7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:31.311687 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f1f23b6b-2271-4ea0-ae42-5e1323afdbc7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:31.312924 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f1f23b6b-2271-4ea0-ae42-5e1323afdbc7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:31.406653 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-f1f23b6b-2271-4ea0-ae42-5e1323afdbc7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:31.414110 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-f1f23b6b-2271-4ea0-ae42-5e1323afdbc7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1211 microversion: 2.1 time: 0.115515 Nov 20 03:30:31.427976 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 432/936] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:31 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1211 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:31.568673 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-865eda4e-f6dc-4915-bffe-b7123040cec8 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:31.580408 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-865eda4e-f6dc-4915-bffe-b7123040cec8 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1550 microversion: 2.1 time: 0.340418 Nov 20 03:30:31.583987 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 505/937] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:31 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1550 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:31.598211 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-84227ab6-7d8e-4ec6-8e1e-e95a154aa277 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:31.599094 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-84227ab6-7d8e-4ec6-8e1e-e95a154aa277 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:31.623752 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-84227ab6-7d8e-4ec6-8e1e-e95a154aa277 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:31.625728 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-84227ab6-7d8e-4ec6-8e1e-e95a154aa277 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:31.628464 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-84227ab6-7d8e-4ec6-8e1e-e95a154aa277 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:31.629748 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-84227ab6-7d8e-4ec6-8e1e-e95a154aa277 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:31.893537 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-d3d144b2-dcb4-47db-9524-15b6b304a390 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:31.894589 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-d3d144b2-dcb4-47db-9524-15b6b304a390 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:31.910984 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d3d144b2-dcb4-47db-9524-15b6b304a390 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:31.911726 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d3d144b2-dcb4-47db-9524-15b6b304a390 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:31.912888 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d3d144b2-dcb4-47db-9524-15b6b304a390 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:31.913556 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d3d144b2-dcb4-47db-9524-15b6b304a390 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:32.050477 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-84227ab6-7d8e-4ec6-8e1e-e95a154aa277 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:32.061005 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-84227ab6-7d8e-4ec6-8e1e-e95a154aa277 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1550 microversion: 2.1 time: 0.466820 Nov 20 03:30:32.061690 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 433/938] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:31 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1550 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:32.079640 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-57d60715-b600-4d26-87b9-eae974f2b590 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:32.085219 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:30:32.085219 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:30:32.088556 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-57d60715-b600-4d26-87b9-eae974f2b590 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:32.090464 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-57d60715-b600-4d26-87b9-eae974f2b590 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Searching by: {'deleted': False, 'project_id': 'c53d3d6966164babbb24206f254ee2d5'} {{(pid=116114) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 03:30:32.104283 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-57d60715-b600-4d26-87b9-eae974f2b590 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:32.106254 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-57d60715-b600-4d26-87b9-eae974f2b590 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:32.108250 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-57d60715-b600-4d26-87b9-eae974f2b590 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:32.125571 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-57d60715-b600-4d26-87b9-eae974f2b590 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:32.258563 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.multi_cell_list [None req-57d60715-b600-4d26-87b9-eae974f2b590 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116114) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 03:30:32.343734 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-d3d144b2-dcb4-47db-9524-15b6b304a390 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:32.366676 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-d3d144b2-dcb4-47db-9524-15b6b304a390 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:32.377031 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-d3d144b2-dcb4-47db-9524-15b6b304a390 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:32.379326 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-d3d144b2-dcb4-47db-9524-15b6b304a390 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1737 microversion: 2.20 time: 0.489708 Nov 20 03:30:32.391377 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 506/939] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:31 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1737 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:32.434343 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-3d3fd791-935f-4d1b-9e90-9773a5d70cd1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:32.435633 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-3d3fd791-935f-4d1b-9e90-9773a5d70cd1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:32.437453 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-57d60715-b600-4d26-87b9-eae974f2b590 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.364742 Nov 20 03:30:32.443412 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 434/940] 10.222.0.37 () {58 vars in 1124 bytes} [Sat Nov 20 03:30:32 2021] GET /compute/v2.1/servers => generated 343 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:30:32.444459 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3d3fd791-935f-4d1b-9e90-9773a5d70cd1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:32.445191 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3d3fd791-935f-4d1b-9e90-9773a5d70cd1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:32.446256 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3d3fd791-935f-4d1b-9e90-9773a5d70cd1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:32.446931 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3d3fd791-935f-4d1b-9e90-9773a5d70cd1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:32.453342 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-f24a38ac-d013-401d-ad63-fe4d8efc70dc tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:32.458722 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-f24a38ac-d013-401d-ad63-fe4d8efc70dc tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:32.471261 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f24a38ac-d013-401d-ad63-fe4d8efc70dc tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:32.472017 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f24a38ac-d013-401d-ad63-fe4d8efc70dc tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:32.472975 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f24a38ac-d013-401d-ad63-fe4d8efc70dc tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:32.473552 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f24a38ac-d013-401d-ad63-fe4d8efc70dc tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:32.786541 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-3d3fd791-935f-4d1b-9e90-9773a5d70cd1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:32.798046 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-3d3fd791-935f-4d1b-9e90-9773a5d70cd1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1267 microversion: 2.1 time: 0.368577 Nov 20 03:30:32.799427 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 507/941] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:32 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1267 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:33.074612 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-915bc3cf-b19f-4841-8fc9-cca9946e3bd1 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:33.074612 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-915bc3cf-b19f-4841-8fc9-cca9946e3bd1 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: 51fdb082-29f4-42ab-96d3-86dcfd59910c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:33.081096 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-915bc3cf-b19f-4841-8fc9-cca9946e3bd1 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:33.081560 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-915bc3cf-b19f-4841-8fc9-cca9946e3bd1 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:33.082424 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-915bc3cf-b19f-4841-8fc9-cca9946e3bd1 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:33.082889 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-915bc3cf-b19f-4841-8fc9-cca9946e3bd1 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:33.113154 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-915bc3cf-b19f-4841-8fc9-cca9946e3bd1 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: 51fdb082-29f4-42ab-96d3-86dcfd59910c] Going to try to terminate instance {{(pid=116113) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 03:30:33.127511 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-f24a38ac-d013-401d-ad63-fe4d8efc70dc tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:33.135865 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-f24a38ac-d013-401d-ad63-fe4d8efc70dc tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1550 microversion: 2.1 time: 0.686075 Nov 20 03:30:33.136712 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 435/942] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:32 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1550 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:33.197084 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-915bc3cf-b19f-4841-8fc9-cca9946e3bd1 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "DELETE /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c" status: 204 len: 0 microversion: 2.1 time: 0.126580 Nov 20 03:30:33.200097 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 508/943] 10.222.0.37 () {58 vars in 1238 bytes} [Sat Nov 20 03:30:33 2021] DELETE /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 20 03:30:33.209128 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-0d2ada81-6609-4880-baf9-17d3d3e8b707 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:33.209736 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-0d2ada81-6609-4880-baf9-17d3d3e8b707 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: 51fdb082-29f4-42ab-96d3-86dcfd59910c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:33.216654 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0d2ada81-6609-4880-baf9-17d3d3e8b707 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:33.217330 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0d2ada81-6609-4880-baf9-17d3d3e8b707 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:33.218336 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0d2ada81-6609-4880-baf9-17d3d3e8b707 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:33.218966 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0d2ada81-6609-4880-baf9-17d3d3e8b707 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:33.390960 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-0a05f546-fe7f-44e1-abd4-71bb730a917d req-3b912aea-5ea5-424a-97d1-500a09d92a7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d3e9138-6765-44c1-af74-6a6d69eecdd5", "tag": "7fab1476-2c92-464e-a1e2-23830e67426c"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:30:33.390960 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:30:33.390960 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:30:33.405187 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-0a05f546-fe7f-44e1-abd4-71bb730a917d req-3b912aea-5ea5-424a-97d1-500a09d92a7a service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:33.405962 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-0a05f546-fe7f-44e1-abd4-71bb730a917d req-3b912aea-5ea5-424a-97d1-500a09d92a7a service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:33.433655 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-0a05f546-fe7f-44e1-abd4-71bb730a917d req-3b912aea-5ea5-424a-97d1-500a09d92a7a service nova] Creating event network-changed:7fab1476-2c92-464e-a1e2-23830e67426c for instance 1d3e9138-6765-44c1-af74-6a6d69eecdd5 on hv-cinder-81803 Nov 20 03:30:33.443147 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-0a05f546-fe7f-44e1-abd4-71bb730a917d req-3b912aea-5ea5-424a-97d1-500a09d92a7a service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054459 Nov 20 03:30:33.444371 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 509/944] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:30:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:30:33.451130 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-a0d818b8-e832-4661-80ed-89bc5f33e340 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:33.452028 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-a0d818b8-e832-4661-80ed-89bc5f33e340 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:33.459641 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a0d818b8-e832-4661-80ed-89bc5f33e340 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:33.460374 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a0d818b8-e832-4661-80ed-89bc5f33e340 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:33.461910 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a0d818b8-e832-4661-80ed-89bc5f33e340 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:33.462552 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-a0d818b8-e832-4661-80ed-89bc5f33e340 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:33.480995 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-0d2ada81-6609-4880-baf9-17d3d3e8b707 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:33.489714 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-0d2ada81-6609-4880-baf9-17d3d3e8b707 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c" status: 200 len: 1514 microversion: 2.1 time: 0.284720 Nov 20 03:30:33.491538 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 436/945] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:33 2021] GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c => generated 1514 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:33.699179 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a0d818b8-e832-4661-80ed-89bc5f33e340 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:33.707889 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a0d818b8-e832-4661-80ed-89bc5f33e340 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:33.709424 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-a0d818b8-e832-4661-80ed-89bc5f33e340 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:33.710577 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-a0d818b8-e832-4661-80ed-89bc5f33e340 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1737 microversion: 2.20 time: 0.264346 Nov 20 03:30:33.711841 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 510/946] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:33 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1737 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:33.814153 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-ce148fb6-3bd9-4359-b09a-fcdf4e059de8 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:33.814797 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-ce148fb6-3bd9-4359-b09a-fcdf4e059de8 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:33.820688 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ce148fb6-3bd9-4359-b09a-fcdf4e059de8 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:33.821147 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ce148fb6-3bd9-4359-b09a-fcdf4e059de8 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:33.821928 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ce148fb6-3bd9-4359-b09a-fcdf4e059de8 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:33.822366 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ce148fb6-3bd9-4359-b09a-fcdf4e059de8 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:34.042771 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-ce148fb6-3bd9-4359-b09a-fcdf4e059de8 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:34.050796 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-ce148fb6-3bd9-4359-b09a-fcdf4e059de8 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1267 microversion: 2.1 time: 0.240225 Nov 20 03:30:34.051376 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 437/947] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:33 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1267 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:34.510708 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-c3b326c9-4244-41a7-9378-abbaaaacfd56 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:34.511341 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-c3b326c9-4244-41a7-9378-abbaaaacfd56 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: 51fdb082-29f4-42ab-96d3-86dcfd59910c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:34.519720 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c3b326c9-4244-41a7-9378-abbaaaacfd56 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:34.520201 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c3b326c9-4244-41a7-9378-abbaaaacfd56 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:34.520986 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c3b326c9-4244-41a7-9378-abbaaaacfd56 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:34.521418 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c3b326c9-4244-41a7-9378-abbaaaacfd56 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:34.692824 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-c3b326c9-4244-41a7-9378-abbaaaacfd56 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:34.700411 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-c3b326c9-4244-41a7-9378-abbaaaacfd56 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c" status: 200 len: 1514 microversion: 2.1 time: 0.195967 Nov 20 03:30:34.708972 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 511/948] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:34 2021] GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c => generated 1514 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:34.716224 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-34361ebf-806b-4ac8-9fec-6d8fb28127b0 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2076503f-58e0-46fb-b495-5d5cfa8cdfe1"}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:30:34.717344 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-34361ebf-806b-4ac8-9fec-6d8fb28127b0 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:34.725499 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-34361ebf-806b-4ac8-9fec-6d8fb28127b0 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:34.725947 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-34361ebf-806b-4ac8-9fec-6d8fb28127b0 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:34.727418 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-34361ebf-806b-4ac8-9fec-6d8fb28127b0 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:34.729028 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-34361ebf-806b-4ac8-9fec-6d8fb28127b0 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:34.730260 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-c5a8ee07-7aca-4619-bf36-2505690c1fba tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:34.730951 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-c5a8ee07-7aca-4619-bf36-2505690c1fba tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:34.737059 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c5a8ee07-7aca-4619-bf36-2505690c1fba tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:34.737525 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c5a8ee07-7aca-4619-bf36-2505690c1fba tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:34.738383 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c5a8ee07-7aca-4619-bf36-2505690c1fba tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:34.738886 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c5a8ee07-7aca-4619-bf36-2505690c1fba tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:34.957910 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-c5a8ee07-7aca-4619-bf36-2505690c1fba tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:34.966439 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-c5a8ee07-7aca-4619-bf36-2505690c1fba tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:34.968264 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-c5a8ee07-7aca-4619-bf36-2505690c1fba tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:34.969559 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-c5a8ee07-7aca-4619-bf36-2505690c1fba tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1719 microversion: 2.20 time: 0.243729 Nov 20 03:30:34.980039 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 512/949] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:34 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1719 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:30:34.997716 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-34361ebf-806b-4ac8-9fec-6d8fb28127b0 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "POST /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285328 Nov 20 03:30:34.998448 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 438/950] 10.222.0.37 () {60 vars in 1322 bytes} [Sat Nov 20 03:30:34 2021] POST /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:30:35.067134 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-e356c198-aff9-473a-a0a3-e6491dffb3e0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:35.068001 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-e356c198-aff9-473a-a0a3-e6491dffb3e0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:35.074384 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e356c198-aff9-473a-a0a3-e6491dffb3e0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:35.074826 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e356c198-aff9-473a-a0a3-e6491dffb3e0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:35.075599 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e356c198-aff9-473a-a0a3-e6491dffb3e0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:35.076060 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e356c198-aff9-473a-a0a3-e6491dffb3e0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:35.283581 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-e356c198-aff9-473a-a0a3-e6491dffb3e0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:35.290941 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-e356c198-aff9-473a-a0a3-e6491dffb3e0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1267 microversion: 2.1 time: 0.227365 Nov 20 03:30:35.291591 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 513/951] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:35 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1267 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:35.717959 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-c51a2c88-fd11-4db9-9400-211b5dc4fb5c tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:35.718647 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-c51a2c88-fd11-4db9-9400-211b5dc4fb5c tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: 51fdb082-29f4-42ab-96d3-86dcfd59910c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:35.725270 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c51a2c88-fd11-4db9-9400-211b5dc4fb5c tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:35.725705 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c51a2c88-fd11-4db9-9400-211b5dc4fb5c tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:35.730362 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c51a2c88-fd11-4db9-9400-211b5dc4fb5c tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:35.730362 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c51a2c88-fd11-4db9-9400-211b5dc4fb5c tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:35.866166 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-c51a2c88-fd11-4db9-9400-211b5dc4fb5c tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:35.874104 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-c51a2c88-fd11-4db9-9400-211b5dc4fb5c tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c" status: 200 len: 1514 microversion: 2.1 time: 0.160332 Nov 20 03:30:35.874670 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 439/952] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:35 2021] GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:35.988858 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-bf0b4895-c82a-4eb6-a5de-c3a620e43ff3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:35.989387 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-bf0b4895-c82a-4eb6-a5de-c3a620e43ff3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:35.995838 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bf0b4895-c82a-4eb6-a5de-c3a620e43ff3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:35.996302 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bf0b4895-c82a-4eb6-a5de-c3a620e43ff3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:35.997087 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bf0b4895-c82a-4eb6-a5de-c3a620e43ff3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:35.997527 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bf0b4895-c82a-4eb6-a5de-c3a620e43ff3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:36.236737 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-bf0b4895-c82a-4eb6-a5de-c3a620e43ff3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:36.245563 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-bf0b4895-c82a-4eb6-a5de-c3a620e43ff3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:36.247204 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-bf0b4895-c82a-4eb6-a5de-c3a620e43ff3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:36.248537 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-bf0b4895-c82a-4eb6-a5de-c3a620e43ff3 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1719 microversion: 2.20 time: 0.263415 Nov 20 03:30:36.249524 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 514/953] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:35 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1719 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:36.253965 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-d850449e-02a6-4aab-8eba-d901a2225740 req-7003e363-1e8d-4b70-b9a5-59ea930ebd11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea9197b-774d-4dc7-9461-3a5ab4e5e7a0", "name": "network-vif-unplugged", "status": "completed", "tag": "09e4f458-7d7a-4be0-87eb-4f821050a3c3"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:30:36.255971 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:30:36.255971 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:30:36.265359 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-d850449e-02a6-4aab-8eba-d901a2225740 req-7003e363-1e8d-4b70-b9a5-59ea930ebd11 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:36.265800 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-d850449e-02a6-4aab-8eba-d901a2225740 req-7003e363-1e8d-4b70-b9a5-59ea930ebd11 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:36.278863 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-d850449e-02a6-4aab-8eba-d901a2225740 req-7003e363-1e8d-4b70-b9a5-59ea930ebd11 service nova] Creating event network-vif-unplugged:09e4f458-7d7a-4be0-87eb-4f821050a3c3 for instance eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 on hv-cinder-81803 Nov 20 03:30:36.283963 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-d850449e-02a6-4aab-8eba-d901a2225740 req-7003e363-1e8d-4b70-b9a5-59ea930ebd11 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033838 Nov 20 03:30:36.284571 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 440/954] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:30:36 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:30:36.307659 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-dff40ff1-27f6-4834-9d9f-e44537750000 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:36.308554 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-dff40ff1-27f6-4834-9d9f-e44537750000 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:36.314533 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dff40ff1-27f6-4834-9d9f-e44537750000 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:36.315098 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dff40ff1-27f6-4834-9d9f-e44537750000 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:36.316035 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dff40ff1-27f6-4834-9d9f-e44537750000 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:36.316568 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-dff40ff1-27f6-4834-9d9f-e44537750000 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:36.515578 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-dff40ff1-27f6-4834-9d9f-e44537750000 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:36.522854 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-dff40ff1-27f6-4834-9d9f-e44537750000 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1267 microversion: 2.1 time: 0.219102 Nov 20 03:30:36.524091 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 515/955] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:36 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1267 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:36.593626 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-78036c7b-7613-4eb6-819f-60e5e15f24e9 req-eee3eb43-d3e7-4dc0-b665-fc31927fa540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51fdb082-29f4-42ab-96d3-86dcfd59910c", "name": "network-vif-deleted", "tag": "569f4ec5-7ea9-449a-b464-3b76e47b73a2"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:30:36.596067 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:30:36.596067 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:30:36.604469 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-78036c7b-7613-4eb6-819f-60e5e15f24e9 req-eee3eb43-d3e7-4dc0-b665-fc31927fa540 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:36.604941 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-78036c7b-7613-4eb6-819f-60e5e15f24e9 req-eee3eb43-d3e7-4dc0-b665-fc31927fa540 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:36.615390 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-78036c7b-7613-4eb6-819f-60e5e15f24e9 req-eee3eb43-d3e7-4dc0-b665-fc31927fa540 service nova] Creating event network-vif-deleted:569f4ec5-7ea9-449a-b464-3b76e47b73a2 for instance 51fdb082-29f4-42ab-96d3-86dcfd59910c on hv-cinder-81803 Nov 20 03:30:36.620773 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-78036c7b-7613-4eb6-819f-60e5e15f24e9 req-eee3eb43-d3e7-4dc0-b665-fc31927fa540 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031104 Nov 20 03:30:36.621358 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 441/956] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:30:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:30:36.890302 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-447cee83-9bad-4032-bdb6-d90b1d58984a tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:36.891046 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-447cee83-9bad-4032-bdb6-d90b1d58984a tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: 51fdb082-29f4-42ab-96d3-86dcfd59910c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:36.897096 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-447cee83-9bad-4032-bdb6-d90b1d58984a tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:36.897605 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-447cee83-9bad-4032-bdb6-d90b1d58984a tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:36.898407 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-447cee83-9bad-4032-bdb6-d90b1d58984a tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:36.898838 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-447cee83-9bad-4032-bdb6-d90b1d58984a tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:36.932439 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-447cee83-9bad-4032-bdb6-d90b1d58984a tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:36.933136 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-447cee83-9bad-4032-bdb6-d90b1d58984a tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:36.933774 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.objects.instance [None req-447cee83-9bad-4032-bdb6-d90b1d58984a tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lazy-loading 'fault' on Instance uuid 51fdb082-29f4-42ab-96d3-86dcfd59910c {{(pid=116113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 03:30:36.977366 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-447cee83-9bad-4032-bdb6-d90b1d58984a tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bb4c48a413496c985d201933aad911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe445c6e096a48fc860957cb4adc25b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:36.984645 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-447cee83-9bad-4032-bdb6-d90b1d58984a tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c" status: 200 len: 1309 microversion: 2.1 time: 0.098000 Nov 20 03:30:36.985200 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 516/957] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:36 2021] GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:37.268513 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-04fe6a4f-e09c-43b5-8b47-1af4685b5d83 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:37.269209 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-04fe6a4f-e09c-43b5-8b47-1af4685b5d83 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:37.275282 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-04fe6a4f-e09c-43b5-8b47-1af4685b5d83 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:37.275734 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-04fe6a4f-e09c-43b5-8b47-1af4685b5d83 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:37.276545 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-04fe6a4f-e09c-43b5-8b47-1af4685b5d83 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:37.276984 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-04fe6a4f-e09c-43b5-8b47-1af4685b5d83 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:37.407196 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-04fe6a4f-e09c-43b5-8b47-1af4685b5d83 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:37.415552 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-04fe6a4f-e09c-43b5-8b47-1af4685b5d83 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:37.417094 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-04fe6a4f-e09c-43b5-8b47-1af4685b5d83 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:37.418250 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-04fe6a4f-e09c-43b5-8b47-1af4685b5d83 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1722 microversion: 2.20 time: 0.154382 Nov 20 03:30:37.418819 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 442/958] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:37 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:37.435920 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ed9a52ce-1a24-405d-8f59-3fd403a31528 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7386057f-5507-42bc-8e54-6a5409f95f2b"}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:30:37.437070 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ed9a52ce-1a24-405d-8f59-3fd403a31528 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:37.443934 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ed9a52ce-1a24-405d-8f59-3fd403a31528 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:37.444390 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ed9a52ce-1a24-405d-8f59-3fd403a31528 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:37.445239 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ed9a52ce-1a24-405d-8f59-3fd403a31528 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:37.445673 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ed9a52ce-1a24-405d-8f59-3fd403a31528 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:37.539442 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-1dc533c7-160b-42c5-9610-b9f5101de6ca tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:37.540096 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-1dc533c7-160b-42c5-9610-b9f5101de6ca tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:37.546129 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1dc533c7-160b-42c5-9610-b9f5101de6ca tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:37.546591 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1dc533c7-160b-42c5-9610-b9f5101de6ca tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:37.547429 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1dc533c7-160b-42c5-9610-b9f5101de6ca tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:37.548008 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1dc533c7-160b-42c5-9610-b9f5101de6ca tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:37.685348 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-1dc533c7-160b-42c5-9610-b9f5101de6ca tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:37.692991 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-1dc533c7-160b-42c5-9610-b9f5101de6ca tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1267 microversion: 2.1 time: 0.157222 Nov 20 03:30:37.693566 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 443/959] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:37 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:37.719235 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ed9a52ce-1a24-405d-8f59-3fd403a31528 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.287099 Nov 20 03:30:37.719865 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 517/960] 10.222.0.37 () {62 vars in 1363 bytes} [Sat Nov 20 03:30:37 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/os-volume_attachments => generated 188 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:30:37.826548 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-ddde8b3e-58e4-47e1-9fec-38dacb0de5a0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:37.827036 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-ddde8b3e-58e4-47e1-9fec-38dacb0de5a0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:37.832770 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ddde8b3e-58e4-47e1-9fec-38dacb0de5a0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:37.833220 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ddde8b3e-58e4-47e1-9fec-38dacb0de5a0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:37.833996 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ddde8b3e-58e4-47e1-9fec-38dacb0de5a0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:37.834430 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ddde8b3e-58e4-47e1-9fec-38dacb0de5a0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:38.002083 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-0385f1ad-6def-401d-9890-693f65728426 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:38.002819 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-0385f1ad-6def-401d-9890-693f65728426 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] [instance: 51fdb082-29f4-42ab-96d3-86dcfd59910c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:38.009280 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0385f1ad-6def-401d-9890-693f65728426 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:38.009831 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0385f1ad-6def-401d-9890-693f65728426 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:38.010703 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0385f1ad-6def-401d-9890-693f65728426 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:38.011215 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0385f1ad-6def-401d-9890-693f65728426 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:38.023949 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.wsgi [None req-0385f1ad-6def-401d-9890-693f65728426 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] HTTP exception thrown: Instance 51fdb082-29f4-42ab-96d3-86dcfd59910c could not be found. Nov 20 03:30:38.024634 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-0385f1ad-6def-401d-9890-693f65728426 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] Returning 404 to user: Instance 51fdb082-29f4-42ab-96d3-86dcfd59910c could not be found. {{(pid=116113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:30:38.025570 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-0385f1ad-6def-401d-9890-693f65728426 tempest-VolumesSnapshotTestJSON-749078653 tempest-VolumesSnapshotTestJSON-749078653-project] 10.222.0.37 "GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c" status: 404 len: 111 microversion: 2.1 time: 0.027073 Nov 20 03:30:38.026158 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 518/961] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:37 2021] GET /compute/v2.1/servers/51fdb082-29f4-42ab-96d3-86dcfd59910c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 03:30:38.068170 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-ddde8b3e-58e4-47e1-9fec-38dacb0de5a0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "DELETE /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/os-volume_attachments/7386057f-5507-42bc-8e54-6a5409f95f2b" status: 202 len: 0 microversion: 2.20 time: 0.245243 Nov 20 03:30:38.068758 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 444/962] 10.222.0.37 () {60 vars in 1456 bytes} [Sat Nov 20 03:30:37 2021] DELETE /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/os-volume_attachments/7386057f-5507-42bc-8e54-6a5409f95f2b => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 20 03:30:38.123713 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-2cb1a04b-7742-4306-8edc-f58d9820fcde tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:30:38.124309 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-2cb1a04b-7742-4306-8edc-f58d9820fcde tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:38.130088 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2cb1a04b-7742-4306-8edc-f58d9820fcde tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:38.130540 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2cb1a04b-7742-4306-8edc-f58d9820fcde tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:38.131320 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2cb1a04b-7742-4306-8edc-f58d9820fcde tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:38.131754 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2cb1a04b-7742-4306-8edc-f58d9820fcde tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:38.221910 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-2cb1a04b-7742-4306-8edc-f58d9820fcde tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action" status: 202 len: 0 microversion: 2.20 time: 0.101789 Nov 20 03:30:38.225962 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 519/963] 10.222.0.37 () {62 vars in 1318 bytes} [Sat Nov 20 03:30:38 2021] POST /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 20 03:30:38.231472 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-a8daa97e-dc14-4636-ab43-90a11ca89062 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:38.232186 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-a8daa97e-dc14-4636-ab43-90a11ca89062 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:38.239361 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a8daa97e-dc14-4636-ab43-90a11ca89062 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:38.239833 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a8daa97e-dc14-4636-ab43-90a11ca89062 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:38.240621 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a8daa97e-dc14-4636-ab43-90a11ca89062 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:38.241048 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a8daa97e-dc14-4636-ab43-90a11ca89062 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:38.394450 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-a8daa97e-dc14-4636-ab43-90a11ca89062 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:38.403095 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-a8daa97e-dc14-4636-ab43-90a11ca89062 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:38.404783 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-a8daa97e-dc14-4636-ab43-90a11ca89062 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:38.406080 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-a8daa97e-dc14-4636-ab43-90a11ca89062 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1670 microversion: 2.20 time: 0.178513 Nov 20 03:30:38.406721 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 445/964] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:38 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1670 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:38.711638 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-33b47eb0-1146-4048-bc4e-993f154ae3e0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:38.712418 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-33b47eb0-1146-4048-bc4e-993f154ae3e0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:38.718168 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-33b47eb0-1146-4048-bc4e-993f154ae3e0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:38.718580 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-33b47eb0-1146-4048-bc4e-993f154ae3e0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:38.719348 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-33b47eb0-1146-4048-bc4e-993f154ae3e0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:38.719804 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-33b47eb0-1146-4048-bc4e-993f154ae3e0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:38.872619 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-33b47eb0-1146-4048-bc4e-993f154ae3e0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:38.880422 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-33b47eb0-1146-4048-bc4e-993f154ae3e0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1267 microversion: 2.1 time: 0.173727 Nov 20 03:30:38.880993 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 520/965] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:38 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:30:39.426702 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-416d7c46-f58e-4faa-9818-ed69d094e7a0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:39.427340 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-416d7c46-f58e-4faa-9818-ed69d094e7a0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:39.438961 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-416d7c46-f58e-4faa-9818-ed69d094e7a0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:39.440147 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-416d7c46-f58e-4faa-9818-ed69d094e7a0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:39.441229 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-416d7c46-f58e-4faa-9818-ed69d094e7a0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:39.441672 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-416d7c46-f58e-4faa-9818-ed69d094e7a0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:39.632472 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-416d7c46-f58e-4faa-9818-ed69d094e7a0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:39.640749 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-416d7c46-f58e-4faa-9818-ed69d094e7a0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:39.642254 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-416d7c46-f58e-4faa-9818-ed69d094e7a0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:39.643628 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-416d7c46-f58e-4faa-9818-ed69d094e7a0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1728 microversion: 2.20 time: 0.222205 Nov 20 03:30:39.644257 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 446/966] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:39 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1728 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:39.897709 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-269a4228-f5c9-4c24-b451-413fecf5baa9 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:39.898906 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-269a4228-f5c9-4c24-b451-413fecf5baa9 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:39.905428 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-269a4228-f5c9-4c24-b451-413fecf5baa9 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:39.905884 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-269a4228-f5c9-4c24-b451-413fecf5baa9 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:39.906672 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-269a4228-f5c9-4c24-b451-413fecf5baa9 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:39.907109 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-269a4228-f5c9-4c24-b451-413fecf5baa9 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:40.049444 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-269a4228-f5c9-4c24-b451-413fecf5baa9 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:40.057071 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-269a4228-f5c9-4c24-b451-413fecf5baa9 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1267 microversion: 2.1 time: 0.163070 Nov 20 03:30:40.057635 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 521/967] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:39 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:40.662822 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-b57db34c-17a7-4839-8e25-cfe5034c7458 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:40.663571 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-b57db34c-17a7-4839-8e25-cfe5034c7458 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:40.670130 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b57db34c-17a7-4839-8e25-cfe5034c7458 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:40.670584 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b57db34c-17a7-4839-8e25-cfe5034c7458 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:40.671368 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b57db34c-17a7-4839-8e25-cfe5034c7458 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:40.671915 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b57db34c-17a7-4839-8e25-cfe5034c7458 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:40.808190 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-b57db34c-17a7-4839-8e25-cfe5034c7458 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:40.816540 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-b57db34c-17a7-4839-8e25-cfe5034c7458 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:40.818014 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-b57db34c-17a7-4839-8e25-cfe5034c7458 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:40.819154 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-b57db34c-17a7-4839-8e25-cfe5034c7458 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1728 microversion: 2.20 time: 0.160317 Nov 20 03:30:40.819734 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 447/968] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:40 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:41.073520 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-77438837-7769-402e-9eaa-574b987bd1d8 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:41.074060 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-77438837-7769-402e-9eaa-574b987bd1d8 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:41.080573 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-77438837-7769-402e-9eaa-574b987bd1d8 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:41.081018 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-77438837-7769-402e-9eaa-574b987bd1d8 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:41.081794 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-77438837-7769-402e-9eaa-574b987bd1d8 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:41.082221 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-77438837-7769-402e-9eaa-574b987bd1d8 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:41.219382 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-77438837-7769-402e-9eaa-574b987bd1d8 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:41.227761 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-77438837-7769-402e-9eaa-574b987bd1d8 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1267 microversion: 2.1 time: 0.157983 Nov 20 03:30:41.228411 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 522/969] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:41 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:41.837458 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-66f7604b-f8da-4d60-85fe-0d5d115c5c7e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:41.838060 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-66f7604b-f8da-4d60-85fe-0d5d115c5c7e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:41.845422 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-66f7604b-f8da-4d60-85fe-0d5d115c5c7e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:41.846126 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-66f7604b-f8da-4d60-85fe-0d5d115c5c7e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:41.846914 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-66f7604b-f8da-4d60-85fe-0d5d115c5c7e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:41.847351 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-66f7604b-f8da-4d60-85fe-0d5d115c5c7e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:41.986200 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-66f7604b-f8da-4d60-85fe-0d5d115c5c7e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:41.994825 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-66f7604b-f8da-4d60-85fe-0d5d115c5c7e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:41.996358 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-66f7604b-f8da-4d60-85fe-0d5d115c5c7e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:41.997533 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-66f7604b-f8da-4d60-85fe-0d5d115c5c7e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1728 microversion: 2.20 time: 0.164273 Nov 20 03:30:41.998080 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 448/970] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:41 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:42.244967 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-529c6bfe-67d5-43ac-a307-5be22574fe99 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:42.245580 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-529c6bfe-67d5-43ac-a307-5be22574fe99 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:42.251963 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-529c6bfe-67d5-43ac-a307-5be22574fe99 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:42.252420 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-529c6bfe-67d5-43ac-a307-5be22574fe99 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:42.253199 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-529c6bfe-67d5-43ac-a307-5be22574fe99 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:42.253638 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-529c6bfe-67d5-43ac-a307-5be22574fe99 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:42.390284 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-529c6bfe-67d5-43ac-a307-5be22574fe99 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:42.397613 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-529c6bfe-67d5-43ac-a307-5be22574fe99 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1267 microversion: 2.1 time: 0.156761 Nov 20 03:30:42.398213 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 523/971] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:42 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:43.017459 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-68c1763c-39e4-445f-a9c3-dcc26e85fba6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:43.018062 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-68c1763c-39e4-445f-a9c3-dcc26e85fba6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:43.025265 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-68c1763c-39e4-445f-a9c3-dcc26e85fba6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:43.025715 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-68c1763c-39e4-445f-a9c3-dcc26e85fba6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:43.026492 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-68c1763c-39e4-445f-a9c3-dcc26e85fba6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:43.026933 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-68c1763c-39e4-445f-a9c3-dcc26e85fba6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:43.178151 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-68c1763c-39e4-445f-a9c3-dcc26e85fba6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:43.187721 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-68c1763c-39e4-445f-a9c3-dcc26e85fba6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:43.189992 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-68c1763c-39e4-445f-a9c3-dcc26e85fba6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:43.191151 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-68c1763c-39e4-445f-a9c3-dcc26e85fba6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1728 microversion: 2.20 time: 0.177475 Nov 20 03:30:43.191703 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 449/972] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:43 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:43.414313 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-4df5d704-1ab3-4715-a50c-ff049a45f7a7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:43.415033 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-4df5d704-1ab3-4715-a50c-ff049a45f7a7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:43.432127 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4df5d704-1ab3-4715-a50c-ff049a45f7a7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:43.432670 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4df5d704-1ab3-4715-a50c-ff049a45f7a7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:43.433539 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4df5d704-1ab3-4715-a50c-ff049a45f7a7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:43.434053 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4df5d704-1ab3-4715-a50c-ff049a45f7a7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:43.702293 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-4df5d704-1ab3-4715-a50c-ff049a45f7a7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:43.713111 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-4df5d704-1ab3-4715-a50c-ff049a45f7a7 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1267 microversion: 2.1 time: 0.302387 Nov 20 03:30:43.716092 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 524/973] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:43 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1267 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:44.210806 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-cdd69e4a-da12-49fa-b40e-3eac20bc8fdf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:44.211569 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-cdd69e4a-da12-49fa-b40e-3eac20bc8fdf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:44.217887 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cdd69e4a-da12-49fa-b40e-3eac20bc8fdf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:44.218340 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cdd69e4a-da12-49fa-b40e-3eac20bc8fdf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:44.219150 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cdd69e4a-da12-49fa-b40e-3eac20bc8fdf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:44.219588 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cdd69e4a-da12-49fa-b40e-3eac20bc8fdf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:44.363115 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-cdd69e4a-da12-49fa-b40e-3eac20bc8fdf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:44.371616 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-cdd69e4a-da12-49fa-b40e-3eac20bc8fdf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:44.373173 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-cdd69e4a-da12-49fa-b40e-3eac20bc8fdf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:44.377636 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-cdd69e4a-da12-49fa-b40e-3eac20bc8fdf tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1728 microversion: 2.20 time: 0.171134 Nov 20 03:30:44.378544 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 450/974] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:44 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:44.730325 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-98718ae8-20f4-433d-b0bc-3b508c194381 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:44.734790 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-98718ae8-20f4-433d-b0bc-3b508c194381 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:44.750360 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-98718ae8-20f4-433d-b0bc-3b508c194381 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:44.751174 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-98718ae8-20f4-433d-b0bc-3b508c194381 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:44.752200 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-98718ae8-20f4-433d-b0bc-3b508c194381 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:44.752609 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-98718ae8-20f4-433d-b0bc-3b508c194381 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:44.951205 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-98718ae8-20f4-433d-b0bc-3b508c194381 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:44.959580 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-98718ae8-20f4-433d-b0bc-3b508c194381 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1267 microversion: 2.1 time: 0.232924 Nov 20 03:30:44.960228 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 525/975] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:44 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1267 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:45.396575 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-a33a8c09-9791-4fab-88be-509ded5ce009 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:45.397979 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-a33a8c09-9791-4fab-88be-509ded5ce009 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:45.407628 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a33a8c09-9791-4fab-88be-509ded5ce009 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:45.409612 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a33a8c09-9791-4fab-88be-509ded5ce009 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:45.411510 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a33a8c09-9791-4fab-88be-509ded5ce009 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:45.412861 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a33a8c09-9791-4fab-88be-509ded5ce009 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:45.583012 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-a33a8c09-9791-4fab-88be-509ded5ce009 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:45.593434 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-a33a8c09-9791-4fab-88be-509ded5ce009 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:45.594942 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-a33a8c09-9791-4fab-88be-509ded5ce009 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:45.596408 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-a33a8c09-9791-4fab-88be-509ded5ce009 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1728 microversion: 2.20 time: 0.203941 Nov 20 03:30:45.596963 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 451/976] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:45 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1728 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:45.977682 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-1f7836e5-5d52-42c1-9253-2dff5c8b6272 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:45.978433 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-1f7836e5-5d52-42c1-9253-2dff5c8b6272 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:45.984901 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1f7836e5-5d52-42c1-9253-2dff5c8b6272 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:45.986858 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1f7836e5-5d52-42c1-9253-2dff5c8b6272 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:45.987646 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1f7836e5-5d52-42c1-9253-2dff5c8b6272 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:45.988125 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1f7836e5-5d52-42c1-9253-2dff5c8b6272 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:46.154066 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-1f7836e5-5d52-42c1-9253-2dff5c8b6272 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:46.167857 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-1f7836e5-5d52-42c1-9253-2dff5c8b6272 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1267 microversion: 2.1 time: 0.194637 Nov 20 03:30:46.172258 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 526/977] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:45 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1267 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:46.618507 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-4c67c386-3224-4390-9144-54efb3aa8648 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:46.620048 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-4c67c386-3224-4390-9144-54efb3aa8648 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:46.627640 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4c67c386-3224-4390-9144-54efb3aa8648 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:46.628370 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4c67c386-3224-4390-9144-54efb3aa8648 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:46.629446 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4c67c386-3224-4390-9144-54efb3aa8648 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:46.629989 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4c67c386-3224-4390-9144-54efb3aa8648 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:46.839595 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-70d4e7dd-da57-4f9d-9fe0-453e31c688f5 req-69006ecf-dabc-4fae-9f6e-5e88f982e3e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d3e9138-6765-44c1-af74-6a6d69eecdd5", "name": "network-vif-plugged", "status": "completed", "tag": "7fab1476-2c92-464e-a1e2-23830e67426c"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:30:46.841832 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:30:46.841832 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:30:46.850118 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-70d4e7dd-da57-4f9d-9fe0-453e31c688f5 req-69006ecf-dabc-4fae-9f6e-5e88f982e3e9 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:46.850571 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-70d4e7dd-da57-4f9d-9fe0-453e31c688f5 req-69006ecf-dabc-4fae-9f6e-5e88f982e3e9 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:46.864506 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-70d4e7dd-da57-4f9d-9fe0-453e31c688f5 req-69006ecf-dabc-4fae-9f6e-5e88f982e3e9 service nova] Creating event network-vif-plugged:7fab1476-2c92-464e-a1e2-23830e67426c for instance 1d3e9138-6765-44c1-af74-6a6d69eecdd5 on hv-cinder-81803 Nov 20 03:30:46.869123 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-4c67c386-3224-4390-9144-54efb3aa8648 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:46.879234 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-4c67c386-3224-4390-9144-54efb3aa8648 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:46.880426 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-70d4e7dd-da57-4f9d-9fe0-453e31c688f5 req-69006ecf-dabc-4fae-9f6e-5e88f982e3e9 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050102 Nov 20 03:30:46.881201 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 527/978] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:30:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:30:46.881742 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-4c67c386-3224-4390-9144-54efb3aa8648 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:46.883210 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-4c67c386-3224-4390-9144-54efb3aa8648 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1728 microversion: 2.20 time: 0.269487 Nov 20 03:30:46.884386 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 452/979] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:46 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1728 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:47.186679 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-493ed070-bbf8-47a2-b7e4-55ad8037f962 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:47.187611 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-493ed070-bbf8-47a2-b7e4-55ad8037f962 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:47.198434 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-493ed070-bbf8-47a2-b7e4-55ad8037f962 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:47.198996 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-493ed070-bbf8-47a2-b7e4-55ad8037f962 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:47.199890 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-493ed070-bbf8-47a2-b7e4-55ad8037f962 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:47.200416 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-493ed070-bbf8-47a2-b7e4-55ad8037f962 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:47.354402 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-493ed070-bbf8-47a2-b7e4-55ad8037f962 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:47.362191 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-493ed070-bbf8-47a2-b7e4-55ad8037f962 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1267 microversion: 2.1 time: 0.180512 Nov 20 03:30:47.362781 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 528/980] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:47 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:47.904588 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-a626b721-a8ac-41cf-9634-fd4237d18ac9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:47.905195 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-a626b721-a8ac-41cf-9634-fd4237d18ac9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:47.917406 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a626b721-a8ac-41cf-9634-fd4237d18ac9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:47.917861 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a626b721-a8ac-41cf-9634-fd4237d18ac9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:47.922306 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a626b721-a8ac-41cf-9634-fd4237d18ac9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:47.922776 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a626b721-a8ac-41cf-9634-fd4237d18ac9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:48.085527 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-a626b721-a8ac-41cf-9634-fd4237d18ac9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:48.094546 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-a626b721-a8ac-41cf-9634-fd4237d18ac9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:48.096453 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-a626b721-a8ac-41cf-9634-fd4237d18ac9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:48.097782 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-a626b721-a8ac-41cf-9634-fd4237d18ac9 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1728 microversion: 2.20 time: 0.200090 Nov 20 03:30:48.098459 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 453/981] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:47 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1728 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:48.378734 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-40faa3b2-4503-4227-a209-691d1a2f97cb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:48.379352 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-40faa3b2-4503-4227-a209-691d1a2f97cb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:48.386038 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-40faa3b2-4503-4227-a209-691d1a2f97cb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:48.386491 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-40faa3b2-4503-4227-a209-691d1a2f97cb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:48.387354 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-40faa3b2-4503-4227-a209-691d1a2f97cb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:48.387935 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-40faa3b2-4503-4227-a209-691d1a2f97cb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:48.522428 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-40faa3b2-4503-4227-a209-691d1a2f97cb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:48.529948 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-40faa3b2-4503-4227-a209-691d1a2f97cb tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1267 microversion: 2.1 time: 0.155022 Nov 20 03:30:48.530539 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 529/982] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:48 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:49.116284 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-9fd974c9-ae85-40fe-910c-a5e7131734b7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:49.116838 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-9fd974c9-ae85-40fe-910c-a5e7131734b7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:49.123364 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9fd974c9-ae85-40fe-910c-a5e7131734b7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:49.124105 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9fd974c9-ae85-40fe-910c-a5e7131734b7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:49.124992 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9fd974c9-ae85-40fe-910c-a5e7131734b7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:49.125506 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9fd974c9-ae85-40fe-910c-a5e7131734b7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:49.268787 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-9fd974c9-ae85-40fe-910c-a5e7131734b7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:49.277494 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-9fd974c9-ae85-40fe-910c-a5e7131734b7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:49.279013 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-9fd974c9-ae85-40fe-910c-a5e7131734b7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:49.280237 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-9fd974c9-ae85-40fe-910c-a5e7131734b7 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1728 microversion: 2.20 time: 0.167671 Nov 20 03:30:49.280798 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 454/983] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:49 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:49.546306 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-526dbcde-044e-43ac-a7a3-731e784395b2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:49.546999 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-526dbcde-044e-43ac-a7a3-731e784395b2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:49.553314 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-526dbcde-044e-43ac-a7a3-731e784395b2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:49.554271 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-526dbcde-044e-43ac-a7a3-731e784395b2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:49.555060 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-526dbcde-044e-43ac-a7a3-731e784395b2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:49.555494 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-526dbcde-044e-43ac-a7a3-731e784395b2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:49.695999 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-526dbcde-044e-43ac-a7a3-731e784395b2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:49.703723 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-526dbcde-044e-43ac-a7a3-731e784395b2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1267 microversion: 2.1 time: 0.161035 Nov 20 03:30:49.704323 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 530/984] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:49 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:50.300060 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-4e0226c5-b3ef-4f8d-85fd-762a54f76d1c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:50.300730 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-4e0226c5-b3ef-4f8d-85fd-762a54f76d1c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:50.307987 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4e0226c5-b3ef-4f8d-85fd-762a54f76d1c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:50.308440 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4e0226c5-b3ef-4f8d-85fd-762a54f76d1c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:50.309231 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4e0226c5-b3ef-4f8d-85fd-762a54f76d1c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:50.309668 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4e0226c5-b3ef-4f8d-85fd-762a54f76d1c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:50.440112 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-4e0226c5-b3ef-4f8d-85fd-762a54f76d1c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:50.447911 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-4e0226c5-b3ef-4f8d-85fd-762a54f76d1c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:50.449367 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-4e0226c5-b3ef-4f8d-85fd-762a54f76d1c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:50.450516 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-4e0226c5-b3ef-4f8d-85fd-762a54f76d1c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1728 microversion: 2.20 time: 0.154923 Nov 20 03:30:50.451077 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 455/985] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:50 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:50.722003 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-bea115db-a6f2-4821-97c5-e7465fee3d8a tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:50.722757 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-bea115db-a6f2-4821-97c5-e7465fee3d8a tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:50.729813 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bea115db-a6f2-4821-97c5-e7465fee3d8a tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:50.730265 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bea115db-a6f2-4821-97c5-e7465fee3d8a tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:50.731094 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bea115db-a6f2-4821-97c5-e7465fee3d8a tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:50.731539 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bea115db-a6f2-4821-97c5-e7465fee3d8a tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:50.869072 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-bea115db-a6f2-4821-97c5-e7465fee3d8a tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:50.876395 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-bea115db-a6f2-4821-97c5-e7465fee3d8a tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1267 microversion: 2.1 time: 0.159274 Nov 20 03:30:50.876963 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 531/986] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:50 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:51.470538 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-821e7a93-106f-406f-ab87-0d8ec47bf5eb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:51.471422 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-821e7a93-106f-406f-ab87-0d8ec47bf5eb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:51.478673 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-821e7a93-106f-406f-ab87-0d8ec47bf5eb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:51.479128 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-821e7a93-106f-406f-ab87-0d8ec47bf5eb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:51.479940 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-821e7a93-106f-406f-ab87-0d8ec47bf5eb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:51.480381 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-821e7a93-106f-406f-ab87-0d8ec47bf5eb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:51.605801 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-821e7a93-106f-406f-ab87-0d8ec47bf5eb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:51.614161 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-821e7a93-106f-406f-ab87-0d8ec47bf5eb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:51.615658 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-821e7a93-106f-406f-ab87-0d8ec47bf5eb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:51.617432 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-821e7a93-106f-406f-ab87-0d8ec47bf5eb tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1728 microversion: 2.20 time: 0.150687 Nov 20 03:30:51.617991 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 456/987] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:51 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:51.894481 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-d608de72-b575-4a54-8880-4ad3b68a5f40 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:51.896172 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-d608de72-b575-4a54-8880-4ad3b68a5f40 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:51.904300 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d608de72-b575-4a54-8880-4ad3b68a5f40 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:51.905337 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d608de72-b575-4a54-8880-4ad3b68a5f40 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:51.906535 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d608de72-b575-4a54-8880-4ad3b68a5f40 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:51.907481 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d608de72-b575-4a54-8880-4ad3b68a5f40 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:52.073790 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-d608de72-b575-4a54-8880-4ad3b68a5f40 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:52.082308 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-d608de72-b575-4a54-8880-4ad3b68a5f40 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1267 microversion: 2.1 time: 0.192122 Nov 20 03:30:52.088452 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 532/988] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:51 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:52.636251 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-34b11991-0106-4bac-b9c1-e5939ae5cd5a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:52.636891 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-34b11991-0106-4bac-b9c1-e5939ae5cd5a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:52.643009 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-34b11991-0106-4bac-b9c1-e5939ae5cd5a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:52.643456 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-34b11991-0106-4bac-b9c1-e5939ae5cd5a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:52.644255 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-34b11991-0106-4bac-b9c1-e5939ae5cd5a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:52.644688 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-34b11991-0106-4bac-b9c1-e5939ae5cd5a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:52.775710 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-34b11991-0106-4bac-b9c1-e5939ae5cd5a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:52.784196 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-34b11991-0106-4bac-b9c1-e5939ae5cd5a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:52.785709 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-34b11991-0106-4bac-b9c1-e5939ae5cd5a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:52.786868 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-34b11991-0106-4bac-b9c1-e5939ae5cd5a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1728 microversion: 2.20 time: 0.154972 Nov 20 03:30:52.787422 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 457/989] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:52 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:53.101491 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-56d1b805-2d4f-4289-a3d0-e85a308a343e tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:53.102359 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-56d1b805-2d4f-4289-a3d0-e85a308a343e tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:53.109094 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-56d1b805-2d4f-4289-a3d0-e85a308a343e tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:53.109636 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-56d1b805-2d4f-4289-a3d0-e85a308a343e tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:53.110506 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-56d1b805-2d4f-4289-a3d0-e85a308a343e tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:53.111021 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-56d1b805-2d4f-4289-a3d0-e85a308a343e tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:53.251946 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-56d1b805-2d4f-4289-a3d0-e85a308a343e tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:53.259249 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-56d1b805-2d4f-4289-a3d0-e85a308a343e tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1267 microversion: 2.1 time: 0.162295 Nov 20 03:30:53.259839 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 533/990] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:53 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:53.805340 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-9e40634b-5950-409c-8678-b20c5507c9e6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:53.806569 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-9e40634b-5950-409c-8678-b20c5507c9e6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:53.812247 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9e40634b-5950-409c-8678-b20c5507c9e6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:53.812698 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9e40634b-5950-409c-8678-b20c5507c9e6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:53.813472 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9e40634b-5950-409c-8678-b20c5507c9e6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:53.813910 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9e40634b-5950-409c-8678-b20c5507c9e6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:53.946949 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-9e40634b-5950-409c-8678-b20c5507c9e6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:53.956622 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-9e40634b-5950-409c-8678-b20c5507c9e6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:53.958407 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-9e40634b-5950-409c-8678-b20c5507c9e6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:53.973579 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-9e40634b-5950-409c-8678-b20c5507c9e6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1728 microversion: 2.20 time: 0.172006 Nov 20 03:30:53.974188 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 458/991] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:53 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:54.275725 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-c8307226-c52d-443a-9f5d-fb2ce5173301 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:54.276359 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-c8307226-c52d-443a-9f5d-fb2ce5173301 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:54.282785 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c8307226-c52d-443a-9f5d-fb2ce5173301 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:54.283230 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c8307226-c52d-443a-9f5d-fb2ce5173301 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:54.284031 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c8307226-c52d-443a-9f5d-fb2ce5173301 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:54.284464 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c8307226-c52d-443a-9f5d-fb2ce5173301 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:54.437934 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-c8307226-c52d-443a-9f5d-fb2ce5173301 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:54.446192 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-c8307226-c52d-443a-9f5d-fb2ce5173301 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1267 microversion: 2.1 time: 0.174095 Nov 20 03:30:54.455603 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 534/992] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:54 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:54.992646 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-5bdc0cfb-76a6-4512-940a-78134f5b1303 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:54.993270 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-5bdc0cfb-76a6-4512-940a-78134f5b1303 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:54.999876 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5bdc0cfb-76a6-4512-940a-78134f5b1303 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:55.000282 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5bdc0cfb-76a6-4512-940a-78134f5b1303 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:55.001054 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5bdc0cfb-76a6-4512-940a-78134f5b1303 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:55.001481 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5bdc0cfb-76a6-4512-940a-78134f5b1303 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:55.135047 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-5bdc0cfb-76a6-4512-940a-78134f5b1303 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:55.142752 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-5bdc0cfb-76a6-4512-940a-78134f5b1303 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:55.144299 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-5bdc0cfb-76a6-4512-940a-78134f5b1303 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:55.145434 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-5bdc0cfb-76a6-4512-940a-78134f5b1303 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1728 microversion: 2.20 time: 0.156702 Nov 20 03:30:55.146013 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 459/993] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:54 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:55.462930 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-3f1571a9-1f2c-48b8-82e4-1c9c294e47b5 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:55.464196 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-3f1571a9-1f2c-48b8-82e4-1c9c294e47b5 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:55.471153 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3f1571a9-1f2c-48b8-82e4-1c9c294e47b5 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:55.471600 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3f1571a9-1f2c-48b8-82e4-1c9c294e47b5 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:55.473229 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3f1571a9-1f2c-48b8-82e4-1c9c294e47b5 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:55.473673 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3f1571a9-1f2c-48b8-82e4-1c9c294e47b5 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:55.602803 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-3f1571a9-1f2c-48b8-82e4-1c9c294e47b5 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:55.610165 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-3f1571a9-1f2c-48b8-82e4-1c9c294e47b5 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1267 microversion: 2.1 time: 0.151270 Nov 20 03:30:55.611027 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 535/994] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:55 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:30:56.164031 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-09337b70-4648-47b1-b15c-7d25930d53c6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:56.164718 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-09337b70-4648-47b1-b15c-7d25930d53c6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:56.171512 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-09337b70-4648-47b1-b15c-7d25930d53c6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:56.172052 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-09337b70-4648-47b1-b15c-7d25930d53c6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:56.173067 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-09337b70-4648-47b1-b15c-7d25930d53c6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:56.173526 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-09337b70-4648-47b1-b15c-7d25930d53c6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:56.307126 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-09337b70-4648-47b1-b15c-7d25930d53c6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:56.316177 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-09337b70-4648-47b1-b15c-7d25930d53c6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:56.317942 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-09337b70-4648-47b1-b15c-7d25930d53c6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:56.319335 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-09337b70-4648-47b1-b15c-7d25930d53c6 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1728 microversion: 2.20 time: 0.159027 Nov 20 03:30:56.320128 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 460/995] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:56 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:56.627669 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-5024c302-7469-40bd-8094-4ebd610d42fd tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:56.628328 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-5024c302-7469-40bd-8094-4ebd610d42fd tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:56.635223 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5024c302-7469-40bd-8094-4ebd610d42fd tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:56.635672 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5024c302-7469-40bd-8094-4ebd610d42fd tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:56.636478 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5024c302-7469-40bd-8094-4ebd610d42fd tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:56.636935 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5024c302-7469-40bd-8094-4ebd610d42fd tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:56.769955 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-5024c302-7469-40bd-8094-4ebd610d42fd tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:56.777154 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-5024c302-7469-40bd-8094-4ebd610d42fd tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1267 microversion: 2.1 time: 0.153160 Nov 20 03:30:56.777748 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 536/996] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:56 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:57.338532 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-482ef04d-98ba-4b2d-95d7-e018c9438340 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:57.339682 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-482ef04d-98ba-4b2d-95d7-e018c9438340 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:57.346156 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-482ef04d-98ba-4b2d-95d7-e018c9438340 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:57.346608 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-482ef04d-98ba-4b2d-95d7-e018c9438340 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:57.347392 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-482ef04d-98ba-4b2d-95d7-e018c9438340 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:57.347861 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-482ef04d-98ba-4b2d-95d7-e018c9438340 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:57.403682 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-f526fe16-0106-4010-b69d-3abd2d25a305 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:57.404348 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f526fe16-0106-4010-b69d-3abd2d25a305 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:57.410130 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f526fe16-0106-4010-b69d-3abd2d25a305 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:57.410579 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f526fe16-0106-4010-b69d-3abd2d25a305 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:57.411357 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f526fe16-0106-4010-b69d-3abd2d25a305 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:57.411827 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f526fe16-0106-4010-b69d-3abd2d25a305 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:57.518061 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-482ef04d-98ba-4b2d-95d7-e018c9438340 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:57.526318 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-482ef04d-98ba-4b2d-95d7-e018c9438340 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:57.527841 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-482ef04d-98ba-4b2d-95d7-e018c9438340 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:57.529004 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-482ef04d-98ba-4b2d-95d7-e018c9438340 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1728 microversion: 2.20 time: 0.194799 Nov 20 03:30:57.529566 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 461/997] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:57 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1728 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:57.561266 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-f526fe16-0106-4010-b69d-3abd2d25a305 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:57.569045 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-f526fe16-0106-4010-b69d-3abd2d25a305 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1596 microversion: 2.1 time: 0.169464 Nov 20 03:30:57.569605 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 537/998] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:57 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1596 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:30:57.794343 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-0c1e963b-c6f2-4521-94ae-7106a5d8e664 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:57.794959 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-0c1e963b-c6f2-4521-94ae-7106a5d8e664 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:57.801110 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0c1e963b-c6f2-4521-94ae-7106a5d8e664 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:57.801562 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0c1e963b-c6f2-4521-94ae-7106a5d8e664 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:57.802342 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0c1e963b-c6f2-4521-94ae-7106a5d8e664 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:57.802777 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0c1e963b-c6f2-4521-94ae-7106a5d8e664 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:58.287649 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-0c1e963b-c6f2-4521-94ae-7106a5d8e664 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:58.295086 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-0c1e963b-c6f2-4521-94ae-7106a5d8e664 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1267 microversion: 2.1 time: 0.504429 Nov 20 03:30:58.295652 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 462/999] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:57 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1267 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:58.546860 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-2a2f3510-2155-4170-b8df-04b944858a4f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:58.547473 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-2a2f3510-2155-4170-b8df-04b944858a4f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:58.553572 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2a2f3510-2155-4170-b8df-04b944858a4f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:58.554022 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2a2f3510-2155-4170-b8df-04b944858a4f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:58.554797 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2a2f3510-2155-4170-b8df-04b944858a4f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:58.555232 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2a2f3510-2155-4170-b8df-04b944858a4f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:58.791346 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-2a2f3510-2155-4170-b8df-04b944858a4f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:58.799244 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-2a2f3510-2155-4170-b8df-04b944858a4f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:58.800882 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-2a2f3510-2155-4170-b8df-04b944858a4f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:58.802037 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-2a2f3510-2155-4170-b8df-04b944858a4f tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1728 microversion: 2.20 time: 0.258918 Nov 20 03:30:58.802590 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 538/1000] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:58 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1728 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:30:59.311632 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-61206a27-56e9-4ac0-9442-b788999a9196 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:59.312191 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-61206a27-56e9-4ac0-9442-b788999a9196 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:59.319357 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-61206a27-56e9-4ac0-9442-b788999a9196 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:59.319919 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-61206a27-56e9-4ac0-9442-b788999a9196 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:59.320707 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-61206a27-56e9-4ac0-9442-b788999a9196 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:59.321665 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-61206a27-56e9-4ac0-9442-b788999a9196 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:59.538950 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-61206a27-56e9-4ac0-9442-b788999a9196 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:59.547364 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-61206a27-56e9-4ac0-9442-b788999a9196 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1454 microversion: 2.1 time: 0.239450 Nov 20 03:30:59.547990 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 463/1001] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:59 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1454 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:59.564275 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-b039f9be-cef7-46cc-989c-e16e4d773f59 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:59.564834 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-b039f9be-cef7-46cc-989c-e16e4d773f59 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:59.571450 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b039f9be-cef7-46cc-989c-e16e4d773f59 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:59.572028 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b039f9be-cef7-46cc-989c-e16e4d773f59 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:59.572916 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b039f9be-cef7-46cc-989c-e16e4d773f59 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:59.573410 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b039f9be-cef7-46cc-989c-e16e4d773f59 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:59.763118 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-59b0163a-5b05-4215-b8b7-079f6135b2e1 req-09e4c755-0db7-4d25-aa83-b74e2cb0fc3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f80295e-5717-4a6a-8ee2-7c0d0d3ea879", "tag": "eb734ba7-0de6-4766-b88e-a690cb07fd57"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:30:59.765425 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:30:59.765425 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:30:59.773593 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-59b0163a-5b05-4215-b8b7-079f6135b2e1 req-09e4c755-0db7-4d25-aa83-b74e2cb0fc3d service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:59.774965 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-59b0163a-5b05-4215-b8b7-079f6135b2e1 req-09e4c755-0db7-4d25-aa83-b74e2cb0fc3d service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:59.788866 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-59b0163a-5b05-4215-b8b7-079f6135b2e1 req-09e4c755-0db7-4d25-aa83-b74e2cb0fc3d service nova] Creating event network-changed:eb734ba7-0de6-4766-b88e-a690cb07fd57 for instance 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 on hv-cinder-81803 Nov 20 03:30:59.795288 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-59b0163a-5b05-4215-b8b7-079f6135b2e1 req-09e4c755-0db7-4d25-aa83-b74e2cb0fc3d service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035748 Nov 20 03:30:59.796614 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 464/1002] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:30:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:30:59.797785 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-b039f9be-cef7-46cc-989c-e16e4d773f59 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:30:59.805644 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-b039f9be-cef7-46cc-989c-e16e4d773f59 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1454 microversion: 2.1 time: 0.245370 Nov 20 03:30:59.806573 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 539/1003] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:30:59 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1454 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:30:59.825822 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-5253868b-6264-43ea-9399-180bb42b024b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:30:59.827456 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-5253868b-6264-43ea-9399-180bb42b024b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:30:59.836192 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5253868b-6264-43ea-9399-180bb42b024b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:59.838476 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5253868b-6264-43ea-9399-180bb42b024b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:30:59.840001 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5253868b-6264-43ea-9399-180bb42b024b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:30:59.841083 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5253868b-6264-43ea-9399-180bb42b024b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:00.134346 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-5253868b-6264-43ea-9399-180bb42b024b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:00.142896 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-5253868b-6264-43ea-9399-180bb42b024b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:00.144793 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-5253868b-6264-43ea-9399-180bb42b024b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:00.146239 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-5253868b-6264-43ea-9399-180bb42b024b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1728 microversion: 2.20 time: 0.328097 Nov 20 03:31:00.161154 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 465/1004] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:30:59 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1728 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:31:00.906493 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-55e77f17-9ef8-4ed1-b963-92badd26cd43 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-345412352"}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:31:00.907035 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-55e77f17-9ef8-4ed1-b963-92badd26cd43 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:00.916835 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-55e77f17-9ef8-4ed1-b963-92badd26cd43 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:00.917720 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-55e77f17-9ef8-4ed1-b963-92badd26cd43 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:00.918693 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-55e77f17-9ef8-4ed1-b963-92badd26cd43 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:00.919274 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-55e77f17-9ef8-4ed1-b963-92badd26cd43 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:01.089727 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.network.security_group_api [None req-55e77f17-9ef8-4ed1-b963-92badd26cd43 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Adding security group b6cb02e0-6f61-4ae3-9a42-d5b44abb9622 to port eb734ba7-0de6-4766-b88e-a690cb07fd57 Nov 20 03:31:01.167703 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-8d36559c-f761-4dd1-8af1-4804c31faf1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:01.176912 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-8d36559c-f761-4dd1-8af1-4804c31faf1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:01.185750 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8d36559c-f761-4dd1-8af1-4804c31faf1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:01.186342 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8d36559c-f761-4dd1-8af1-4804c31faf1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:01.192773 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8d36559c-f761-4dd1-8af1-4804c31faf1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:01.193243 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8d36559c-f761-4dd1-8af1-4804c31faf1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:01.434286 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-8d36559c-f761-4dd1-8af1-4804c31faf1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:01.452381 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-8d36559c-f761-4dd1-8af1-4804c31faf1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:01.453888 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-8d36559c-f761-4dd1-8af1-4804c31faf1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:01.455044 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-8d36559c-f761-4dd1-8af1-4804c31faf1b tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1728 microversion: 2.20 time: 0.291187 Nov 20 03:31:01.471085 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 466/1005] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:31:01 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1728 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:31:01.637321 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-55e77f17-9ef8-4ed1-b963-92badd26cd43 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "POST /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879/action" status: 202 len: 0 microversion: 2.1 time: 0.733844 Nov 20 03:31:01.638713 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 540/1006] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:31:00 2021] POST /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879/action => generated 0 bytes in 737 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:31:01.646202 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-081a27c3-b44d-439d-b552-55ecaf62f83d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:01.646814 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-081a27c3-b44d-439d-b552-55ecaf62f83d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:01.653145 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-081a27c3-b44d-439d-b552-55ecaf62f83d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:01.654006 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-081a27c3-b44d-439d-b552-55ecaf62f83d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:01.659491 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-081a27c3-b44d-439d-b552-55ecaf62f83d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:01.660318 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-081a27c3-b44d-439d-b552-55ecaf62f83d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:01.819746 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-93515833-f7fe-4f88-94e6-9c1bb845e41d req-5f1f52c2-e6e5-4845-bda9-c82ca17fa5d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f80295e-5717-4a6a-8ee2-7c0d0d3ea879", "tag": "eb734ba7-0de6-4766-b88e-a690cb07fd57"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:31:01.821402 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:31:01.821402 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:31:01.830660 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-93515833-f7fe-4f88-94e6-9c1bb845e41d req-5f1f52c2-e6e5-4845-bda9-c82ca17fa5d2 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:01.831117 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-93515833-f7fe-4f88-94e6-9c1bb845e41d req-5f1f52c2-e6e5-4845-bda9-c82ca17fa5d2 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:01.865721 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-93515833-f7fe-4f88-94e6-9c1bb845e41d req-5f1f52c2-e6e5-4845-bda9-c82ca17fa5d2 service nova] Creating event network-changed:eb734ba7-0de6-4766-b88e-a690cb07fd57 for instance 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 on hv-cinder-81803 Nov 20 03:31:01.877670 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-93515833-f7fe-4f88-94e6-9c1bb845e41d req-5f1f52c2-e6e5-4845-bda9-c82ca17fa5d2 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061422 Nov 20 03:31:01.878279 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 541/1007] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:31:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:31:02.003076 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-081a27c3-b44d-439d-b552-55ecaf62f83d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:02.011835 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-081a27c3-b44d-439d-b552-55ecaf62f83d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1761 microversion: 2.1 time: 0.369154 Nov 20 03:31:02.036710 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 467/1008] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:31:01 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1761 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:31:02.482299 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-4db29c1d-bbee-457a-aba0-796cb2a4659a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:02.484433 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-4db29c1d-bbee-457a-aba0-796cb2a4659a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:02.494976 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4db29c1d-bbee-457a-aba0-796cb2a4659a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:02.495734 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4db29c1d-bbee-457a-aba0-796cb2a4659a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:02.497579 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4db29c1d-bbee-457a-aba0-796cb2a4659a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:02.498515 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4db29c1d-bbee-457a-aba0-796cb2a4659a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:02.636239 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-8075910b-35c1-4be3-a60d-618df8304407 req-709a1b7f-d25e-4ee7-8e60-3a3f78262053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d3e9138-6765-44c1-af74-6a6d69eecdd5", "tag": "7fab1476-2c92-464e-a1e2-23830e67426c"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:31:02.639376 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:31:02.639376 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:31:02.650942 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-8075910b-35c1-4be3-a60d-618df8304407 req-709a1b7f-d25e-4ee7-8e60-3a3f78262053 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:02.652154 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-8075910b-35c1-4be3-a60d-618df8304407 req-709a1b7f-d25e-4ee7-8e60-3a3f78262053 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:02.682563 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-8075910b-35c1-4be3-a60d-618df8304407 req-709a1b7f-d25e-4ee7-8e60-3a3f78262053 service nova] Creating event network-changed:7fab1476-2c92-464e-a1e2-23830e67426c for instance 1d3e9138-6765-44c1-af74-6a6d69eecdd5 on hv-cinder-81803 Nov 20 03:31:02.688359 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-8075910b-35c1-4be3-a60d-618df8304407 req-709a1b7f-d25e-4ee7-8e60-3a3f78262053 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120139 Nov 20 03:31:02.689439 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 468/1009] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:31:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:31:02.795506 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-4db29c1d-bbee-457a-aba0-796cb2a4659a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:02.803380 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-4db29c1d-bbee-457a-aba0-796cb2a4659a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:02.805141 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-4db29c1d-bbee-457a-aba0-796cb2a4659a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:02.807086 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-4db29c1d-bbee-457a-aba0-796cb2a4659a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1728 microversion: 2.20 time: 0.332804 Nov 20 03:31:02.807610 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 542/1010] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:31:02 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1728 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:31:03.112219 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-a9e0c4ad-a3cf-4b6d-947e-25fbc4e85b33 req-a8a2a070-f5d0-4d22-8d25-74e01602faf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea9197b-774d-4dc7-9461-3a5ab4e5e7a0", "name": "network-vif-plugged", "status": "completed", "tag": "09e4f458-7d7a-4be0-87eb-4f821050a3c3"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:31:03.114106 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:31:03.114106 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:31:03.122628 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-a9e0c4ad-a3cf-4b6d-947e-25fbc4e85b33 req-a8a2a070-f5d0-4d22-8d25-74e01602faf1 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:03.123402 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-a9e0c4ad-a3cf-4b6d-947e-25fbc4e85b33 req-a8a2a070-f5d0-4d22-8d25-74e01602faf1 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:03.136100 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-a9e0c4ad-a3cf-4b6d-947e-25fbc4e85b33 req-a8a2a070-f5d0-4d22-8d25-74e01602faf1 service nova] Creating event network-vif-plugged:09e4f458-7d7a-4be0-87eb-4f821050a3c3 for instance eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 on hv-cinder-81803 Nov 20 03:31:03.141312 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-a9e0c4ad-a3cf-4b6d-947e-25fbc4e85b33 req-a8a2a070-f5d0-4d22-8d25-74e01602faf1 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033021 Nov 20 03:31:03.142665 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 469/1011] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:31:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:31:03.825322 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-55ef37bd-0795-47b6-b7e8-16abd00227fc tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:03.825935 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-55ef37bd-0795-47b6-b7e8-16abd00227fc tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:03.834292 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-55ef37bd-0795-47b6-b7e8-16abd00227fc tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:03.834744 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-55ef37bd-0795-47b6-b7e8-16abd00227fc tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:03.835585 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-55ef37bd-0795-47b6-b7e8-16abd00227fc tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:03.836027 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-55ef37bd-0795-47b6-b7e8-16abd00227fc tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:03.981099 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-55ef37bd-0795-47b6-b7e8-16abd00227fc tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:03.988868 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-55ef37bd-0795-47b6-b7e8-16abd00227fc tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:03.990380 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-55ef37bd-0795-47b6-b7e8-16abd00227fc tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:03.991560 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-55ef37bd-0795-47b6-b7e8-16abd00227fc tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1728 microversion: 2.20 time: 0.169950 Nov 20 03:31:03.992157 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 543/1012] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:31:03 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:31:05.010323 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-4fb11437-4652-43cb-97de-70d2f7ca09d0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:05.011042 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-4fb11437-4652-43cb-97de-70d2f7ca09d0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:05.017658 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4fb11437-4652-43cb-97de-70d2f7ca09d0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:05.018201 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4fb11437-4652-43cb-97de-70d2f7ca09d0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:05.018986 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4fb11437-4652-43cb-97de-70d2f7ca09d0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:05.019418 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4fb11437-4652-43cb-97de-70d2f7ca09d0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:05.158354 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-4fb11437-4652-43cb-97de-70d2f7ca09d0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:05.166029 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-4fb11437-4652-43cb-97de-70d2f7ca09d0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:05.167644 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-4fb11437-4652-43cb-97de-70d2f7ca09d0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:05.168821 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-4fb11437-4652-43cb-97de-70d2f7ca09d0 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1728 microversion: 2.20 time: 0.162572 Nov 20 03:31:05.169378 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 470/1013] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:31:05 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:31:06.186961 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-e153c830-8183-42ce-ba0f-fa6b27f3cae5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:06.187501 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-e153c830-8183-42ce-ba0f-fa6b27f3cae5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:06.194022 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e153c830-8183-42ce-ba0f-fa6b27f3cae5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:06.194474 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e153c830-8183-42ce-ba0f-fa6b27f3cae5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:06.195252 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e153c830-8183-42ce-ba0f-fa6b27f3cae5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:06.195687 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e153c830-8183-42ce-ba0f-fa6b27f3cae5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:06.325840 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-e153c830-8183-42ce-ba0f-fa6b27f3cae5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:06.333525 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-e153c830-8183-42ce-ba0f-fa6b27f3cae5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:06.335023 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-e153c830-8183-42ce-ba0f-fa6b27f3cae5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:06.336199 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-e153c830-8183-42ce-ba0f-fa6b27f3cae5 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1715 microversion: 2.20 time: 0.153002 Nov 20 03:31:06.336748 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 544/1014] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:31:06 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1715 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:31:15.956005 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-0116caa3-593a-47b9-bccf-1547020b47f2 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:31:15.956957 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-0116caa3-593a-47b9-bccf-1547020b47f2 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:15.963951 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0116caa3-593a-47b9-bccf-1547020b47f2 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:15.964413 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0116caa3-593a-47b9-bccf-1547020b47f2 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:15.965189 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0116caa3-593a-47b9-bccf-1547020b47f2 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:15.965627 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0116caa3-593a-47b9-bccf-1547020b47f2 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:16.034306 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-0116caa3-593a-47b9-bccf-1547020b47f2 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "POST /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879/action" status: 202 len: 0 microversion: 2.1 time: 0.081789 Nov 20 03:31:16.037685 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 471/1015] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:31:15 2021] POST /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:31:16.043671 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-fada7f75-d316-4a01-8405-1df6fc803f23 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:16.044327 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-fada7f75-d316-4a01-8405-1df6fc803f23 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:16.050766 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fada7f75-d316-4a01-8405-1df6fc803f23 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:16.051338 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fada7f75-d316-4a01-8405-1df6fc803f23 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:16.052028 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fada7f75-d316-4a01-8405-1df6fc803f23 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:16.052528 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fada7f75-d316-4a01-8405-1df6fc803f23 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:16.229657 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-fada7f75-d316-4a01-8405-1df6fc803f23 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:16.237462 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-fada7f75-d316-4a01-8405-1df6fc803f23 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1753 microversion: 2.1 time: 0.198060 Nov 20 03:31:16.238029 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 545/1016] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:31:16 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1753 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:31:17.255348 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-3796b37f-68e1-415c-83ee-1dd464e8dc23 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:17.255989 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-3796b37f-68e1-415c-83ee-1dd464e8dc23 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:17.263011 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3796b37f-68e1-415c-83ee-1dd464e8dc23 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:17.263459 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3796b37f-68e1-415c-83ee-1dd464e8dc23 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:17.264259 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3796b37f-68e1-415c-83ee-1dd464e8dc23 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:17.264695 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3796b37f-68e1-415c-83ee-1dd464e8dc23 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:17.411738 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-3796b37f-68e1-415c-83ee-1dd464e8dc23 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:17.419480 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-3796b37f-68e1-415c-83ee-1dd464e8dc23 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1758 microversion: 2.1 time: 0.168706 Nov 20 03:31:17.420082 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 472/1017] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:31:17 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:31:18.436551 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-8baf0665-d1d9-41b7-96b3-e87f9f35fb66 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:18.437191 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-8baf0665-d1d9-41b7-96b3-e87f9f35fb66 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:18.443459 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8baf0665-d1d9-41b7-96b3-e87f9f35fb66 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:18.443936 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8baf0665-d1d9-41b7-96b3-e87f9f35fb66 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:18.444710 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8baf0665-d1d9-41b7-96b3-e87f9f35fb66 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:18.445144 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8baf0665-d1d9-41b7-96b3-e87f9f35fb66 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:18.588179 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-8baf0665-d1d9-41b7-96b3-e87f9f35fb66 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:18.596185 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-8baf0665-d1d9-41b7-96b3-e87f9f35fb66 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1758 microversion: 2.1 time: 0.163274 Nov 20 03:31:18.596750 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 546/1018] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:31:18 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:31:19.613641 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-5080596c-6f87-42c3-887b-0778406700b3 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:19.614274 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-5080596c-6f87-42c3-887b-0778406700b3 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:19.620635 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5080596c-6f87-42c3-887b-0778406700b3 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:19.621163 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5080596c-6f87-42c3-887b-0778406700b3 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:19.622135 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5080596c-6f87-42c3-887b-0778406700b3 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:19.622623 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5080596c-6f87-42c3-887b-0778406700b3 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:19.768599 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-5080596c-6f87-42c3-887b-0778406700b3 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:19.776404 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-5080596c-6f87-42c3-887b-0778406700b3 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1758 microversion: 2.1 time: 0.166409 Nov 20 03:31:19.776975 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 473/1019] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:31:19 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:31:20.793735 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-78df06de-8e07-44d7-949f-b33e5b5e5b16 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:20.794343 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-78df06de-8e07-44d7-949f-b33e5b5e5b16 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:20.800538 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-78df06de-8e07-44d7-949f-b33e5b5e5b16 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:20.800982 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-78df06de-8e07-44d7-949f-b33e5b5e5b16 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:20.801743 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-78df06de-8e07-44d7-949f-b33e5b5e5b16 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:20.802171 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-78df06de-8e07-44d7-949f-b33e5b5e5b16 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:20.945761 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-78df06de-8e07-44d7-949f-b33e5b5e5b16 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:20.953569 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-78df06de-8e07-44d7-949f-b33e5b5e5b16 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1758 microversion: 2.1 time: 0.164106 Nov 20 03:31:20.954131 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 547/1020] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:31:20 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:31:21.971344 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-fee57e13-ae84-43c5-acc4-8a47936b6798 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:21.971984 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-fee57e13-ae84-43c5-acc4-8a47936b6798 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:21.978606 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fee57e13-ae84-43c5-acc4-8a47936b6798 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:21.978770 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fee57e13-ae84-43c5-acc4-8a47936b6798 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:21.979547 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fee57e13-ae84-43c5-acc4-8a47936b6798 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:21.979996 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fee57e13-ae84-43c5-acc4-8a47936b6798 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:22.126343 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-fee57e13-ae84-43c5-acc4-8a47936b6798 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:22.136158 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-fee57e13-ae84-43c5-acc4-8a47936b6798 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1758 microversion: 2.1 time: 0.168721 Nov 20 03:31:22.136743 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 474/1021] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:31:21 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:31:23.153454 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-1e5ae769-4381-434e-a99e-820b8038be16 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:23.153993 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-1e5ae769-4381-434e-a99e-820b8038be16 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:23.160274 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1e5ae769-4381-434e-a99e-820b8038be16 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:23.160723 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1e5ae769-4381-434e-a99e-820b8038be16 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:23.161504 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1e5ae769-4381-434e-a99e-820b8038be16 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:23.161941 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1e5ae769-4381-434e-a99e-820b8038be16 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:23.305584 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-1e5ae769-4381-434e-a99e-820b8038be16 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:23.313317 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-1e5ae769-4381-434e-a99e-820b8038be16 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1758 microversion: 2.1 time: 0.163636 Nov 20 03:31:23.313877 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 548/1022] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:31:23 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:31:24.329383 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-953eca33-9dc6-4fbb-a2fa-0632f228e753 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:24.330022 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-953eca33-9dc6-4fbb-a2fa-0632f228e753 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:24.336305 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-953eca33-9dc6-4fbb-a2fa-0632f228e753 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:24.336759 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-953eca33-9dc6-4fbb-a2fa-0632f228e753 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:24.337534 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-953eca33-9dc6-4fbb-a2fa-0632f228e753 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:24.337976 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-953eca33-9dc6-4fbb-a2fa-0632f228e753 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:24.482435 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-953eca33-9dc6-4fbb-a2fa-0632f228e753 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:24.490604 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-953eca33-9dc6-4fbb-a2fa-0632f228e753 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1758 microversion: 2.1 time: 0.164866 Nov 20 03:31:24.491164 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 475/1023] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:31:24 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:31:25.513982 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-3a079fc8-e06b-4502-9104-c52802573077 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:25.514570 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-3a079fc8-e06b-4502-9104-c52802573077 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:25.520732 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3a079fc8-e06b-4502-9104-c52802573077 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:25.521172 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3a079fc8-e06b-4502-9104-c52802573077 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:25.522409 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3a079fc8-e06b-4502-9104-c52802573077 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:25.523615 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3a079fc8-e06b-4502-9104-c52802573077 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:25.664411 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-3a079fc8-e06b-4502-9104-c52802573077 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:25.672004 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-3a079fc8-e06b-4502-9104-c52802573077 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1758 microversion: 2.1 time: 0.161769 Nov 20 03:31:25.672564 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 549/1024] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:31:25 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:31:26.688485 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-c63cc1b0-2d25-435c-bb93-ab8a7a512216 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:26.689137 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-c63cc1b0-2d25-435c-bb93-ab8a7a512216 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:26.695389 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c63cc1b0-2d25-435c-bb93-ab8a7a512216 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:26.695870 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c63cc1b0-2d25-435c-bb93-ab8a7a512216 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:26.696649 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c63cc1b0-2d25-435c-bb93-ab8a7a512216 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:26.697087 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c63cc1b0-2d25-435c-bb93-ab8a7a512216 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:26.841118 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-c63cc1b0-2d25-435c-bb93-ab8a7a512216 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:26.849226 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-c63cc1b0-2d25-435c-bb93-ab8a7a512216 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1758 microversion: 2.1 time: 0.164325 Nov 20 03:31:26.849753 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 476/1025] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:31:26 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:31:27.866362 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-144c6f5f-98d7-4f6d-bce0-44a48b532272 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:27.867612 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-144c6f5f-98d7-4f6d-bce0-44a48b532272 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:27.873487 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-144c6f5f-98d7-4f6d-bce0-44a48b532272 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:27.873929 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-144c6f5f-98d7-4f6d-bce0-44a48b532272 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:27.874692 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-144c6f5f-98d7-4f6d-bce0-44a48b532272 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:27.875120 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-144c6f5f-98d7-4f6d-bce0-44a48b532272 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:28.017163 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-144c6f5f-98d7-4f6d-bce0-44a48b532272 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:28.025337 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-144c6f5f-98d7-4f6d-bce0-44a48b532272 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1758 microversion: 2.1 time: 0.162922 Nov 20 03:31:28.025897 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 550/1026] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:31:27 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:31:29.042220 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-babba5b9-e977-4b50-95b3-942e8aacc05d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:29.042834 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-babba5b9-e977-4b50-95b3-942e8aacc05d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:29.049115 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-babba5b9-e977-4b50-95b3-942e8aacc05d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:29.049560 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-babba5b9-e977-4b50-95b3-942e8aacc05d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:29.050331 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-babba5b9-e977-4b50-95b3-942e8aacc05d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:29.050766 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-babba5b9-e977-4b50-95b3-942e8aacc05d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:29.188640 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-babba5b9-e977-4b50-95b3-942e8aacc05d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:29.197057 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-babba5b9-e977-4b50-95b3-942e8aacc05d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1758 microversion: 2.1 time: 0.159105 Nov 20 03:31:29.197638 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 477/1027] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:31:29 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1758 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:31:30.214371 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-2aab0c63-5d69-4b09-9d54-32223ea3f0a7 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:30.214900 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-2aab0c63-5d69-4b09-9d54-32223ea3f0a7 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:30.221888 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2aab0c63-5d69-4b09-9d54-32223ea3f0a7 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:30.222376 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2aab0c63-5d69-4b09-9d54-32223ea3f0a7 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:30.223152 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2aab0c63-5d69-4b09-9d54-32223ea3f0a7 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:30.223591 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2aab0c63-5d69-4b09-9d54-32223ea3f0a7 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:30.366005 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-2aab0c63-5d69-4b09-9d54-32223ea3f0a7 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:30.374415 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-2aab0c63-5d69-4b09-9d54-32223ea3f0a7 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1758 microversion: 2.1 time: 0.164387 Nov 20 03:31:30.375012 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 551/1028] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:31:30 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:31:31.392016 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-63f8955b-e54c-423a-a8e9-a8996d7922a5 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:31.392633 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-63f8955b-e54c-423a-a8e9-a8996d7922a5 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:31.398982 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-63f8955b-e54c-423a-a8e9-a8996d7922a5 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:31.399434 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-63f8955b-e54c-423a-a8e9-a8996d7922a5 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:31.400253 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-63f8955b-e54c-423a-a8e9-a8996d7922a5 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:31.400696 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-63f8955b-e54c-423a-a8e9-a8996d7922a5 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:31.542619 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-63f8955b-e54c-423a-a8e9-a8996d7922a5 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:31.550449 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-63f8955b-e54c-423a-a8e9-a8996d7922a5 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1758 microversion: 2.1 time: 0.162095 Nov 20 03:31:31.551007 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 478/1029] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:31:31 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:31:32.568122 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-0ad80d8f-8b4f-4e61-912d-b2847ca6c0e9 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:32.568752 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-0ad80d8f-8b4f-4e61-912d-b2847ca6c0e9 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:32.575094 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0ad80d8f-8b4f-4e61-912d-b2847ca6c0e9 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:32.575547 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0ad80d8f-8b4f-4e61-912d-b2847ca6c0e9 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:32.576348 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0ad80d8f-8b4f-4e61-912d-b2847ca6c0e9 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:32.576787 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0ad80d8f-8b4f-4e61-912d-b2847ca6c0e9 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:32.723580 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-0ad80d8f-8b4f-4e61-912d-b2847ca6c0e9 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:32.732446 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-0ad80d8f-8b4f-4e61-912d-b2847ca6c0e9 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1758 microversion: 2.1 time: 0.168018 Nov 20 03:31:32.733023 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 552/1030] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:31:32 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:31:33.749695 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-63c302df-3438-4a45-8fca-1c1443c69079 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:33.750314 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-63c302df-3438-4a45-8fca-1c1443c69079 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:33.756288 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-63c302df-3438-4a45-8fca-1c1443c69079 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:33.756741 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-63c302df-3438-4a45-8fca-1c1443c69079 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:33.757550 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-63c302df-3438-4a45-8fca-1c1443c69079 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:33.757988 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-63c302df-3438-4a45-8fca-1c1443c69079 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:33.898842 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-63c302df-3438-4a45-8fca-1c1443c69079 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:33.906802 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-63c302df-3438-4a45-8fca-1c1443c69079 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1761 microversion: 2.1 time: 0.160949 Nov 20 03:31:33.907372 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 479/1031] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:31:33 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1761 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:31:39.082494 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-7897e2a2-0a9e-4744-ad91-f490721f569c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:39.083478 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-7897e2a2-0a9e-4744-ad91-f490721f569c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:39.089690 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7897e2a2-0a9e-4744-ad91-f490721f569c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:39.090134 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7897e2a2-0a9e-4744-ad91-f490721f569c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:39.090898 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7897e2a2-0a9e-4744-ad91-f490721f569c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:39.091328 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7897e2a2-0a9e-4744-ad91-f490721f569c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:39.120597 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-7897e2a2-0a9e-4744-ad91-f490721f569c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041818 Nov 20 03:31:39.121147 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 553/1032] 10.222.0.37 () {60 vars in 1342 bytes} [Sat Nov 20 03:31:39 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:31:39.174113 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-ff309804-6eba-4c8d-8d70-969fe5db7e63 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:39.174616 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-ff309804-6eba-4c8d-8d70-969fe5db7e63 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:39.182316 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ff309804-6eba-4c8d-8d70-969fe5db7e63 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:39.182770 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ff309804-6eba-4c8d-8d70-969fe5db7e63 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:39.183554 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ff309804-6eba-4c8d-8d70-969fe5db7e63 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:39.184025 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ff309804-6eba-4c8d-8d70-969fe5db7e63 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:39.211290 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-ff309804-6eba-4c8d-8d70-969fe5db7e63 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Going to try to terminate instance {{(pid=116114) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 03:31:39.289095 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-ff309804-6eba-4c8d-8d70-969fe5db7e63 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "DELETE /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 204 len: 0 microversion: 2.20 time: 0.117696 Nov 20 03:31:39.289933 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 480/1033] 10.222.0.37 () {60 vars in 1279 bytes} [Sat Nov 20 03:31:39 2021] DELETE /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 20 03:31:39.297648 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-9ba4fa2b-bd25-47af-abd7-9f8b8d29d98a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:39.298251 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-9ba4fa2b-bd25-47af-abd7-9f8b8d29d98a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:39.304081 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9ba4fa2b-bd25-47af-abd7-9f8b8d29d98a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:39.304520 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9ba4fa2b-bd25-47af-abd7-9f8b8d29d98a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:39.305305 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9ba4fa2b-bd25-47af-abd7-9f8b8d29d98a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:39.305734 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9ba4fa2b-bd25-47af-abd7-9f8b8d29d98a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:39.434346 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9ba4fa2b-bd25-47af-abd7-9f8b8d29d98a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:39.441950 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9ba4fa2b-bd25-47af-abd7-9f8b8d29d98a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:39.443450 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9ba4fa2b-bd25-47af-abd7-9f8b8d29d98a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:39.444621 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-9ba4fa2b-bd25-47af-abd7-9f8b8d29d98a tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1721 microversion: 2.20 time: 0.150620 Nov 20 03:31:39.445168 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 554/1034] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:31:39 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 03:31:40.463147 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-11a5052f-974d-40b2-869b-6ab8c22bae7d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:40.463857 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-11a5052f-974d-40b2-869b-6ab8c22bae7d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:40.470472 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-11a5052f-974d-40b2-869b-6ab8c22bae7d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:40.470856 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-11a5052f-974d-40b2-869b-6ab8c22bae7d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:40.471630 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-11a5052f-974d-40b2-869b-6ab8c22bae7d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:40.472091 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-11a5052f-974d-40b2-869b-6ab8c22bae7d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:40.604206 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-11a5052f-974d-40b2-869b-6ab8c22bae7d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:40.612118 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-11a5052f-974d-40b2-869b-6ab8c22bae7d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:40.613625 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-11a5052f-974d-40b2-869b-6ab8c22bae7d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:40.614777 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-11a5052f-974d-40b2-869b-6ab8c22bae7d tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1721 microversion: 2.20 time: 0.155685 Nov 20 03:31:40.615339 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 481/1035] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:31:40 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:31:41.634343 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-233e260c-e458-4e26-b42a-4fbda2db2413 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:41.634956 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-233e260c-e458-4e26-b42a-4fbda2db2413 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:41.641154 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-233e260c-e458-4e26-b42a-4fbda2db2413 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:41.641602 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-233e260c-e458-4e26-b42a-4fbda2db2413 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:41.642376 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-233e260c-e458-4e26-b42a-4fbda2db2413 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:41.642815 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-233e260c-e458-4e26-b42a-4fbda2db2413 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:41.721895 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-233e260c-e458-4e26-b42a-4fbda2db2413 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:41.733692 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-a5ffab40-65a3-4e3a-90b6-06ff8ecb8b20 req-f04a4804-f6f3-449f-8d65-1f9f6b55ec40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea9197b-774d-4dc7-9461-3a5ab4e5e7a0", "name": "network-vif-deleted", "tag": "09e4f458-7d7a-4be0-87eb-4f821050a3c3"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:31:41.736396 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:31:41.736396 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:31:41.739288 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-233e260c-e458-4e26-b42a-4fbda2db2413 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:41.743854 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-233e260c-e458-4e26-b42a-4fbda2db2413 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7036f594f5e1419a8f12e6657de1ffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd5d5840ac400c82604d0212b124f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:41.744926 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-233e260c-e458-4e26-b42a-4fbda2db2413 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 200 len: 1655 microversion: 2.20 time: 0.114936 Nov 20 03:31:41.745692 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 555/1036] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:31:41 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 1655 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 03:31:41.747013 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-a5ffab40-65a3-4e3a-90b6-06ff8ecb8b20 req-f04a4804-f6f3-449f-8d65-1f9f6b55ec40 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:41.747538 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-a5ffab40-65a3-4e3a-90b6-06ff8ecb8b20 req-f04a4804-f6f3-449f-8d65-1f9f6b55ec40 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:41.761403 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-a5ffab40-65a3-4e3a-90b6-06ff8ecb8b20 req-f04a4804-f6f3-449f-8d65-1f9f6b55ec40 service nova] Creating event network-vif-deleted:09e4f458-7d7a-4be0-87eb-4f821050a3c3 for instance eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 on hv-cinder-81803 Nov 20 03:31:41.767557 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-a5ffab40-65a3-4e3a-90b6-06ff8ecb8b20 req-f04a4804-f6f3-449f-8d65-1f9f6b55ec40 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037562 Nov 20 03:31:41.769581 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 482/1037] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:31:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:31:42.762753 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-5d2886ed-4863-4edf-9e18-3c6476c1fc9c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:42.763357 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-5d2886ed-4863-4edf-9e18-3c6476c1fc9c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:42.769599 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5d2886ed-4863-4edf-9e18-3c6476c1fc9c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:42.770042 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5d2886ed-4863-4edf-9e18-3c6476c1fc9c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:42.770903 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5d2886ed-4863-4edf-9e18-3c6476c1fc9c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:42.771363 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5d2886ed-4863-4edf-9e18-3c6476c1fc9c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:42.784637 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.wsgi [None req-5d2886ed-4863-4edf-9e18-3c6476c1fc9c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] HTTP exception thrown: Instance eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 could not be found. Nov 20 03:31:42.785210 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-5d2886ed-4863-4edf-9e18-3c6476c1fc9c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Returning 404 to user: Instance eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 could not be found. {{(pid=116113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:31:42.786001 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-5d2886ed-4863-4edf-9e18-3c6476c1fc9c tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 404 len: 111 microversion: 2.20 time: 0.027010 Nov 20 03:31:42.786515 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 556/1038] 10.222.0.37 () {60 vars in 1276 bytes} [Sat Nov 20 03:31:42 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 20 03:31:42.795263 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-4b3ff497-0ce4-4ddb-aa5b-d9c84bc782aa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '.version_select at 0x7f2dac749ca0>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:42.813537 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-4b3ff497-0ce4-4ddb-aa5b-d9c84bc782aa tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1229318093" status: 204 len: 0 microversion: 2.20 time: 0.022246 Nov 20 03:31:42.814092 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 483/1039] 10.222.0.37 () {60 vars in 1261 bytes} [Sat Nov 20 03:31:42 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1229318093 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 20 03:31:44.585026 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-00c3368b-140f-4da8-80ad-eaf22841fe95 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:44.585532 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-00c3368b-140f-4da8-80ad-eaf22841fe95 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:44.591718 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-00c3368b-140f-4da8-80ad-eaf22841fe95 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:44.592209 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-00c3368b-140f-4da8-80ad-eaf22841fe95 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:44.592983 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-00c3368b-140f-4da8-80ad-eaf22841fe95 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:44.593422 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-00c3368b-140f-4da8-80ad-eaf22841fe95 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:44.607495 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.wsgi [None req-00c3368b-140f-4da8-80ad-eaf22841fe95 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] HTTP exception thrown: Instance eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 could not be found. Nov 20 03:31:44.608098 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-00c3368b-140f-4da8-80ad-eaf22841fe95 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Returning 404 to user: Instance eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 could not be found. {{(pid=116113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:31:44.608929 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-00c3368b-140f-4da8-80ad-eaf22841fe95 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "DELETE /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 404 len: 111 microversion: 2.1 time: 0.028069 Nov 20 03:31:44.609443 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 557/1040] 10.222.0.37 () {58 vars in 1238 bytes} [Sat Nov 20 03:31:44 2021] DELETE /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:31:44.617442 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-d232741a-e5ed-4b37-9631-e73d9574e68e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:44.618158 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-d232741a-e5ed-4b37-9631-e73d9574e68e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: eea9197b-774d-4dc7-9461-3a5ab4e5e7a0] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:44.626228 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d232741a-e5ed-4b37-9631-e73d9574e68e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:44.626673 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d232741a-e5ed-4b37-9631-e73d9574e68e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:44.627445 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d232741a-e5ed-4b37-9631-e73d9574e68e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:44.627918 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d232741a-e5ed-4b37-9631-e73d9574e68e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:44.640233 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.wsgi [None req-d232741a-e5ed-4b37-9631-e73d9574e68e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] HTTP exception thrown: Instance eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 could not be found. Nov 20 03:31:44.640810 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-d232741a-e5ed-4b37-9631-e73d9574e68e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Returning 404 to user: Instance eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 could not be found. {{(pid=116114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:31:44.641607 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-d232741a-e5ed-4b37-9631-e73d9574e68e tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0" status: 404 len: 111 microversion: 2.1 time: 0.028275 Nov 20 03:31:44.642138 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 484/1041] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:31:44 2021] GET /compute/v2.1/servers/eea9197b-774d-4dc7-9461-3a5ab4e5e7a0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:31:45.767101 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-29a7e991-ee5b-4090-bbc7-c05a73816711 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:45.767634 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-29a7e991-ee5b-4090-bbc7-c05a73816711 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:45.773895 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-29a7e991-ee5b-4090-bbc7-c05a73816711 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:45.774363 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-29a7e991-ee5b-4090-bbc7-c05a73816711 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:45.775127 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-29a7e991-ee5b-4090-bbc7-c05a73816711 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:45.775565 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-29a7e991-ee5b-4090-bbc7-c05a73816711 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:45.789728 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.wsgi [None req-29a7e991-ee5b-4090-bbc7-c05a73816711 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] HTTP exception thrown: Instance f68eb618-c745-43db-a873-7c0700c0f11c could not be found. Nov 20 03:31:45.790304 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-29a7e991-ee5b-4090-bbc7-c05a73816711 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Returning 404 to user: Instance f68eb618-c745-43db-a873-7c0700c0f11c could not be found. {{(pid=116113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:31:45.791106 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-29a7e991-ee5b-4090-bbc7-c05a73816711 tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "DELETE /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 404 len: 111 microversion: 2.1 time: 0.027755 Nov 20 03:31:45.791617 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 558/1042] 10.222.0.37 () {58 vars in 1238 bytes} [Sat Nov 20 03:31:45 2021] DELETE /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:31:45.799268 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-5d583d9f-1ab4-4fa1-8b0c-7701505609de tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:45.799910 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-5d583d9f-1ab4-4fa1-8b0c-7701505609de tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] [instance: f68eb618-c745-43db-a873-7c0700c0f11c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:45.806732 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5d583d9f-1ab4-4fa1-8b0c-7701505609de tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:45.807186 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5d583d9f-1ab4-4fa1-8b0c-7701505609de tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:45.807995 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5d583d9f-1ab4-4fa1-8b0c-7701505609de tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:45.808433 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5d583d9f-1ab4-4fa1-8b0c-7701505609de tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:45.821198 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.wsgi [None req-5d583d9f-1ab4-4fa1-8b0c-7701505609de tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] HTTP exception thrown: Instance f68eb618-c745-43db-a873-7c0700c0f11c could not be found. Nov 20 03:31:45.821773 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-5d583d9f-1ab4-4fa1-8b0c-7701505609de tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] Returning 404 to user: Instance f68eb618-c745-43db-a873-7c0700c0f11c could not be found. {{(pid=116114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:31:45.822588 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-5d583d9f-1ab4-4fa1-8b0c-7701505609de tempest-AttachVolumeShelveTestJSON-1529896285 tempest-AttachVolumeShelveTestJSON-1529896285-project] 10.222.0.37 "GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c" status: 404 len: 111 microversion: 2.1 time: 0.026999 Nov 20 03:31:45.823099 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 485/1043] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:31:45 2021] GET /compute/v2.1/servers/f68eb618-c745-43db-a873-7c0700c0f11c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:31:50.984299 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-70774df4-b72f-4dc7-aeda-ebfbab6a4182 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:50.984983 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-da3a3d20-07ad-4678-bd47-2993e4899861 req-3731a9d1-330c-4bd3-9fbc-c57987780bdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd", "tag": "c4f59d4b-9c47-44dc-ae92-832b37f470bd"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:31:50.986289 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-70774df4-b72f-4dc7-aeda-ebfbab6a4182 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:50.987159 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:31:50.987159 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:31:50.997336 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-da3a3d20-07ad-4678-bd47-2993e4899861 req-3731a9d1-330c-4bd3-9fbc-c57987780bdf service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:50.998063 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-da3a3d20-07ad-4678-bd47-2993e4899861 req-3731a9d1-330c-4bd3-9fbc-c57987780bdf service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:50.998424 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-70774df4-b72f-4dc7-aeda-ebfbab6a4182 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:50.999417 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-70774df4-b72f-4dc7-aeda-ebfbab6a4182 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:51.000667 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-70774df4-b72f-4dc7-aeda-ebfbab6a4182 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:51.001999 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-70774df4-b72f-4dc7-aeda-ebfbab6a4182 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:51.010843 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-da3a3d20-07ad-4678-bd47-2993e4899861 req-3731a9d1-330c-4bd3-9fbc-c57987780bdf service nova] Creating event network-changed:c4f59d4b-9c47-44dc-ae92-832b37f470bd for instance 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd on hv-cinder-81803 Nov 20 03:31:51.017092 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-da3a3d20-07ad-4678-bd47-2993e4899861 req-3731a9d1-330c-4bd3-9fbc-c57987780bdf service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035471 Nov 20 03:31:51.020875 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 486/1044] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:31:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:31:51.035965 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-70774df4-b72f-4dc7-aeda-ebfbab6a4182 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Going to try to terminate instance {{(pid=116113) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 03:31:51.153064 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-70774df4-b72f-4dc7-aeda-ebfbab6a4182 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "DELETE /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 204 len: 0 microversion: 2.1 time: 0.172952 Nov 20 03:31:51.154068 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 559/1045] 10.222.0.37 () {58 vars in 1238 bytes} [Sat Nov 20 03:31:50 2021] DELETE /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 03:31:51.166415 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-8b6b792f-4f34-4e12-b26d-51815f908018 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:51.167589 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-8b6b792f-4f34-4e12-b26d-51815f908018 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:51.175474 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8b6b792f-4f34-4e12-b26d-51815f908018 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:51.176228 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8b6b792f-4f34-4e12-b26d-51815f908018 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:51.177573 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8b6b792f-4f34-4e12-b26d-51815f908018 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:51.178969 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8b6b792f-4f34-4e12-b26d-51815f908018 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:51.539668 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-8b6b792f-4f34-4e12-b26d-51815f908018 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:51.548957 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-8b6b792f-4f34-4e12-b26d-51815f908018 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1568 microversion: 2.1 time: 0.389643 Nov 20 03:31:51.549974 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 487/1046] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:31:51 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1568 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:31:52.570045 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-e3f2b0d7-119c-4a3a-bbca-2c54c4c4e7e3 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:52.570843 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-e3f2b0d7-119c-4a3a-bbca-2c54c4c4e7e3 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:52.577574 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e3f2b0d7-119c-4a3a-bbca-2c54c4c4e7e3 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:52.578044 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e3f2b0d7-119c-4a3a-bbca-2c54c4c4e7e3 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:52.578814 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e3f2b0d7-119c-4a3a-bbca-2c54c4c4e7e3 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:52.579245 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e3f2b0d7-119c-4a3a-bbca-2c54c4c4e7e3 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:52.732905 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-e3f2b0d7-119c-4a3a-bbca-2c54c4c4e7e3 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:52.740312 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-e3f2b0d7-119c-4a3a-bbca-2c54c4c4e7e3 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1449 microversion: 2.1 time: 0.177333 Nov 20 03:31:52.740900 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 560/1047] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:31:52 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1449 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:31:53.712150 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-7c3429d7-d44f-4eac-b67d-d1ac93312002 req-71e372e9-cdb0-4e2b-a1d0-be13a4cc6f72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd", "name": "network-vif-deleted", "tag": "c4f59d4b-9c47-44dc-ae92-832b37f470bd"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:31:53.713769 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:31:53.713769 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:31:53.727967 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-7c3429d7-d44f-4eac-b67d-d1ac93312002 req-71e372e9-cdb0-4e2b-a1d0-be13a4cc6f72 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:53.728712 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-7c3429d7-d44f-4eac-b67d-d1ac93312002 req-71e372e9-cdb0-4e2b-a1d0-be13a4cc6f72 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:53.740636 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-7c3429d7-d44f-4eac-b67d-d1ac93312002 req-71e372e9-cdb0-4e2b-a1d0-be13a4cc6f72 service nova] Creating event network-vif-deleted:c4f59d4b-9c47-44dc-ae92-832b37f470bd for instance 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd on hv-cinder-81803 Nov 20 03:31:53.748837 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-7c3429d7-d44f-4eac-b67d-d1ac93312002 req-71e372e9-cdb0-4e2b-a1d0-be13a4cc6f72 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041062 Nov 20 03:31:53.749436 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 488/1048] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:31:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:31:53.757085 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ae0f39a2-7391-4a0a-9e3a-7b0f9c6dbd00 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:53.757698 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ae0f39a2-7391-4a0a-9e3a-7b0f9c6dbd00 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:53.765244 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ae0f39a2-7391-4a0a-9e3a-7b0f9c6dbd00 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:53.765926 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ae0f39a2-7391-4a0a-9e3a-7b0f9c6dbd00 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:53.766903 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ae0f39a2-7391-4a0a-9e3a-7b0f9c6dbd00 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:53.767507 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ae0f39a2-7391-4a0a-9e3a-7b0f9c6dbd00 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:53.838519 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-ae0f39a2-7391-4a0a-9e3a-7b0f9c6dbd00 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e38fe9c394d3fbc3e826e0d345b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4794dc407c024daf9067e5a879ec056c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:53.848254 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ae0f39a2-7391-4a0a-9e3a-7b0f9c6dbd00 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 200 len: 1219 microversion: 2.1 time: 0.094631 Nov 20 03:31:53.849154 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 561/1049] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:31:53 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:31:54.866636 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-161b2b0a-b6e2-4edc-a04e-0139eb471f27 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:54.867522 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-161b2b0a-b6e2-4edc-a04e-0139eb471f27 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] [instance: 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:54.874847 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-161b2b0a-b6e2-4edc-a04e-0139eb471f27 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:54.875300 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-161b2b0a-b6e2-4edc-a04e-0139eb471f27 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:54.876171 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-161b2b0a-b6e2-4edc-a04e-0139eb471f27 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:54.876557 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-161b2b0a-b6e2-4edc-a04e-0139eb471f27 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:54.892581 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.wsgi [None req-161b2b0a-b6e2-4edc-a04e-0139eb471f27 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] HTTP exception thrown: Instance 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd could not be found. Nov 20 03:31:54.893183 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-161b2b0a-b6e2-4edc-a04e-0139eb471f27 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Returning 404 to user: Instance 3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd could not be found. {{(pid=116114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:31:54.894768 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-161b2b0a-b6e2-4edc-a04e-0139eb471f27 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd" status: 404 len: 111 microversion: 2.1 time: 0.033052 Nov 20 03:31:54.895621 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 489/1050] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:31:54 2021] GET /compute/v2.1/servers/3c5294d2-95f5-41ba-adaf-55a1ed0a5fdd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:31:55.105518 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-9ee4c73f-75e2-4aa8-b946-8f36bcf46995 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] Calling method '.version_select at 0x7f2db18d11f0>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:55.140845 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-9ee4c73f-75e2-4aa8-b946-8f36bcf46995 tempest-TestShelveInstance-1688634498 tempest-TestShelveInstance-1688634498-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-817932630" status: 202 len: 0 microversion: 2.1 time: 0.044152 Nov 20 03:31:55.141995 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 562/1051] 10.222.0.37 () {58 vars in 1250 bytes} [Sat Nov 20 03:31:55 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-817932630 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:31:55.607971 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-90957ba1-f1a0-4b2b-80e4-83b8c1f68caa tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'create', calling method: .version_select at 0x7f2dac7d2a60>, body: {"keypair": {"name": "tempest-keypair-327968092"}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:31:55.623042 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-90957ba1-f1a0-4b2b-80e4-83b8c1f68caa tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Getting quotas for project d08399259f414676ab07f0c72210e61b. Resources: {'key_pairs'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:31:55.628381 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-90957ba1-f1a0-4b2b-80e4-83b8c1f68caa tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Getting quotas for user bdcb25cdee1f450d8c29a1f2b0ea60a7 and project d08399259f414676ab07f0c72210e61b. Resources: {'key_pairs'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:31:55.810354 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-90957ba1-f1a0-4b2b-80e4-83b8c1f68caa tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Getting quotas for project d08399259f414676ab07f0c72210e61b. Resources: {'key_pairs'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:31:55.814051 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-90957ba1-f1a0-4b2b-80e4-83b8c1f68caa tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Getting quotas for user bdcb25cdee1f450d8c29a1f2b0ea60a7 and project d08399259f414676ab07f0c72210e61b. Resources: {'key_pairs'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:31:55.826878 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-90957ba1-f1a0-4b2b-80e4-83b8c1f68caa tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.344134 Nov 20 03:31:55.827475 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 490/1052] 10.222.0.37 () {60 vars in 1157 bytes} [Sat Nov 20 03:31:55 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:31:57.920872 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-1d9c5391-9395-49ac-862f-c542e651b4b7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1299419297", "imageRef": "e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "791637e4-063d-499c-bfca-afedfcc04bcf"}], "security_groups": [{"name": "tempest-securitygroup--2022356583"}], "key_name": "tempest-keypair-327968092", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:31:58.039487 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.network.neutron [None req-1d9c5391-9395-49ac-862f-c542e651b4b7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] validate_networks() for [('791637e4-063d-499c-bfca-afedfcc04bcf', None, None, None, None, None)] {{(pid=116113) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 03:31:58.556180 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-1d9c5391-9395-49ac-862f-c542e651b4b7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Flavor limits 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 03:31:58.556969 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-1d9c5391-9395-49ac-862f-c542e651b4b7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Image limits 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 03:31:58.557780 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-1d9c5391-9395-49ac-862f-c542e651b4b7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Flavor pref 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 03:31:58.558510 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-1d9c5391-9395-49ac-862f-c542e651b4b7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Image pref 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 03:31:58.559404 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-1d9c5391-9395-49ac-862f-c542e651b4b7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 03:31:58.573213 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1d9c5391-9395-49ac-862f-c542e651b4b7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:58.573832 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1d9c5391-9395-49ac-862f-c542e651b4b7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:58.574802 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1d9c5391-9395-49ac-862f-c542e651b4b7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:58.576254 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1d9c5391-9395-49ac-862f-c542e651b4b7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:58.593751 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-1d9c5391-9395-49ac-862f-c542e651b4b7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Getting quotas for project d08399259f414676ab07f0c72210e61b. Resources: {'ram', 'cores', 'instances'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:31:58.598142 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-1d9c5391-9395-49ac-862f-c542e651b4b7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Getting quotas for user bdcb25cdee1f450d8c29a1f2b0ea60a7 and project d08399259f414676ab07f0c72210e61b. Resources: {'ram', 'cores', 'instances'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:31:58.609279 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-1d9c5391-9395-49ac-862f-c542e651b4b7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Going to run 1 instances... {{(pid=116113) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 03:31:58.611600 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-1d9c5391-9395-49ac-862f-c542e651b4b7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 03:31:58.662880 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-1d9c5391-9395-49ac-862f-c542e651b4b7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.746470 Nov 20 03:31:58.663730 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 563/1053] 10.222.0.37 () {60 vars in 1146 bytes} [Sat Nov 20 03:31:57 2021] POST /compute/v2.1/servers => generated 402 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 03:31:58.673143 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-27f6728f-ede6-4da9-82b6-29d41e708af9 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:58.673760 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-27f6728f-ede6-4da9-82b6-29d41e708af9 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:58.732304 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-27f6728f-ede6-4da9-82b6-29d41e708af9 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:58.743078 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-27f6728f-ede6-4da9-82b6-29d41e708af9 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1237 microversion: 2.1 time: 0.073477 Nov 20 03:31:58.743659 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 491/1054] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:31:58 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:31:59.761667 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-7dedf592-5267-400e-9496-1972874d0200 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:31:59.762287 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-7dedf592-5267-400e-9496-1972874d0200 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:31:59.769477 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7dedf592-5267-400e-9496-1972874d0200 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:59.769851 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7dedf592-5267-400e-9496-1972874d0200 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:59.774041 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7dedf592-5267-400e-9496-1972874d0200 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:31:59.774041 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7dedf592-5267-400e-9496-1972874d0200 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:31:59.845295 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-7dedf592-5267-400e-9496-1972874d0200 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:31:59.854927 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-7dedf592-5267-400e-9496-1972874d0200 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1289 microversion: 2.1 time: 0.097785 Nov 20 03:31:59.855775 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 564/1055] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:31:59 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1289 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:32:00.872468 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-62902b4e-9641-4c0d-8185-228e2a85a90c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:00.873085 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-62902b4e-9641-4c0d-8185-228e2a85a90c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:00.880137 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-62902b4e-9641-4c0d-8185-228e2a85a90c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:00.880356 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-62902b4e-9641-4c0d-8185-228e2a85a90c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:00.881321 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-62902b4e-9641-4c0d-8185-228e2a85a90c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:00.881752 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-62902b4e-9641-4c0d-8185-228e2a85a90c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:01.159226 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-62902b4e-9641-4c0d-8185-228e2a85a90c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:32:01.171248 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-62902b4e-9641-4c0d-8185-228e2a85a90c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1363 microversion: 2.1 time: 0.302192 Nov 20 03:32:01.172650 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 492/1056] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:32:00 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1363 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:32:01.803002 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-596373ae-b3f2-4e63-8106-b03ed4a2d258 req-1adf6d38-ff85-4af0-a5fb-456bc0c23a4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2109e70-6d36-409e-a430-4e36ba685082", "tag": "7404f5fe-b108-47a0-b58a-57236ae12240"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:01.804609 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:32:01.804609 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:32:01.812727 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-596373ae-b3f2-4e63-8106-b03ed4a2d258 req-1adf6d38-ff85-4af0-a5fb-456bc0c23a4c service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:01.813363 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-596373ae-b3f2-4e63-8106-b03ed4a2d258 req-1adf6d38-ff85-4af0-a5fb-456bc0c23a4c service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:01.830817 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-596373ae-b3f2-4e63-8106-b03ed4a2d258 req-1adf6d38-ff85-4af0-a5fb-456bc0c23a4c service nova] Creating event network-changed:7404f5fe-b108-47a0-b58a-57236ae12240 for instance e2109e70-6d36-409e-a430-4e36ba685082 on hv-cinder-81803 Nov 20 03:32:01.860372 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-596373ae-b3f2-4e63-8106-b03ed4a2d258 req-1adf6d38-ff85-4af0-a5fb-456bc0c23a4c service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061254 Nov 20 03:32:01.862495 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 565/1057] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:32:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:32:02.190303 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-c6550771-aa55-4cae-a78c-94820cb406da tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:02.191517 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-c6550771-aa55-4cae-a78c-94820cb406da tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:02.198017 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c6550771-aa55-4cae-a78c-94820cb406da tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:02.198469 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c6550771-aa55-4cae-a78c-94820cb406da tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:02.199264 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c6550771-aa55-4cae-a78c-94820cb406da tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:02.199848 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c6550771-aa55-4cae-a78c-94820cb406da tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:02.428281 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-c6550771-aa55-4cae-a78c-94820cb406da tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:32:02.443427 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-c6550771-aa55-4cae-a78c-94820cb406da tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1363 microversion: 2.1 time: 0.258013 Nov 20 03:32:02.454097 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 493/1058] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:32:02 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:32:03.471648 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ef36e9b5-0b10-4f9d-b32b-d1f9ccf92b96 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:03.472281 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ef36e9b5-0b10-4f9d-b32b-d1f9ccf92b96 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:03.478770 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ef36e9b5-0b10-4f9d-b32b-d1f9ccf92b96 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:03.479218 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ef36e9b5-0b10-4f9d-b32b-d1f9ccf92b96 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:03.480107 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ef36e9b5-0b10-4f9d-b32b-d1f9ccf92b96 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:03.480541 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ef36e9b5-0b10-4f9d-b32b-d1f9ccf92b96 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:03.616548 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-ef36e9b5-0b10-4f9d-b32b-d1f9ccf92b96 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:32:03.624626 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ef36e9b5-0b10-4f9d-b32b-d1f9ccf92b96 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1363 microversion: 2.1 time: 0.157671 Nov 20 03:32:03.625587 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 566/1059] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:32:03 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:32:04.642040 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-3ab102cd-8e70-49cb-bb88-2d1f40ceff83 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:04.642937 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-3ab102cd-8e70-49cb-bb88-2d1f40ceff83 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:04.650144 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3ab102cd-8e70-49cb-bb88-2d1f40ceff83 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:04.650598 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3ab102cd-8e70-49cb-bb88-2d1f40ceff83 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:04.651389 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3ab102cd-8e70-49cb-bb88-2d1f40ceff83 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:04.651845 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3ab102cd-8e70-49cb-bb88-2d1f40ceff83 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:04.787943 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-3ab102cd-8e70-49cb-bb88-2d1f40ceff83 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:32:04.795063 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-3ab102cd-8e70-49cb-bb88-2d1f40ceff83 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1363 microversion: 2.1 time: 0.156837 Nov 20 03:32:04.795624 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 494/1060] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:32:04 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:32:05.812297 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-2aa6e018-6557-4817-b555-db5c45e1e6a7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:05.812904 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-2aa6e018-6557-4817-b555-db5c45e1e6a7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:05.819620 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2aa6e018-6557-4817-b555-db5c45e1e6a7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:05.820094 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2aa6e018-6557-4817-b555-db5c45e1e6a7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:05.820859 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2aa6e018-6557-4817-b555-db5c45e1e6a7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:05.821290 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2aa6e018-6557-4817-b555-db5c45e1e6a7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:05.950755 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-2aa6e018-6557-4817-b555-db5c45e1e6a7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:32:05.958039 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-2aa6e018-6557-4817-b555-db5c45e1e6a7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1363 microversion: 2.1 time: 0.149414 Nov 20 03:32:05.959235 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 567/1061] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:32:05 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:32:06.978987 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-5c5aa05d-0747-4f04-be41-bfacc1831d0c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:06.979606 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-5c5aa05d-0747-4f04-be41-bfacc1831d0c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:06.986080 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5c5aa05d-0747-4f04-be41-bfacc1831d0c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:06.986532 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5c5aa05d-0747-4f04-be41-bfacc1831d0c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:06.987322 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5c5aa05d-0747-4f04-be41-bfacc1831d0c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:06.987765 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5c5aa05d-0747-4f04-be41-bfacc1831d0c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:07.115274 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-5c5aa05d-0747-4f04-be41-bfacc1831d0c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:32:07.122525 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-5c5aa05d-0747-4f04-be41-bfacc1831d0c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1363 microversion: 2.1 time: 0.147788 Nov 20 03:32:07.123089 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 495/1062] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:32:06 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:32:07.244042 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-f24286e0-e67b-4d53-92b5-b0464e8f0229 req-1c74e3e9-ad9b-469a-90a3-461a1c1dce59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2109e70-6d36-409e-a430-4e36ba685082", "name": "network-vif-plugged", "status": "completed", "tag": "7404f5fe-b108-47a0-b58a-57236ae12240"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:07.245586 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:32:07.245586 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:32:07.253291 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-f24286e0-e67b-4d53-92b5-b0464e8f0229 req-1c74e3e9-ad9b-469a-90a3-461a1c1dce59 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:07.253825 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-f24286e0-e67b-4d53-92b5-b0464e8f0229 req-1c74e3e9-ad9b-469a-90a3-461a1c1dce59 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:07.265227 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-f24286e0-e67b-4d53-92b5-b0464e8f0229 req-1c74e3e9-ad9b-469a-90a3-461a1c1dce59 service nova] Creating event network-vif-plugged:7404f5fe-b108-47a0-b58a-57236ae12240 for instance e2109e70-6d36-409e-a430-4e36ba685082 on hv-cinder-81803 Nov 20 03:32:07.270093 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-f24286e0-e67b-4d53-92b5-b0464e8f0229 req-1c74e3e9-ad9b-469a-90a3-461a1c1dce59 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030145 Nov 20 03:32:07.270905 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 568/1063] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:32:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:32:08.139755 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-cbedc256-bf95-4290-ad38-6bce74863ca8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:08.140398 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-cbedc256-bf95-4290-ad38-6bce74863ca8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:08.146687 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cbedc256-bf95-4290-ad38-6bce74863ca8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:08.147133 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cbedc256-bf95-4290-ad38-6bce74863ca8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:08.147946 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cbedc256-bf95-4290-ad38-6bce74863ca8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:08.148390 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cbedc256-bf95-4290-ad38-6bce74863ca8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:08.274934 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-cbedc256-bf95-4290-ad38-6bce74863ca8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:32:08.282271 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-cbedc256-bf95-4290-ad38-6bce74863ca8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1363 microversion: 2.1 time: 0.146155 Nov 20 03:32:08.282835 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 496/1064] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:32:08 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:32:09.162465 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-d6773e39-053a-4fa3-94b5-5f0342bea15c tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-345412352"}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:09.163087 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-d6773e39-053a-4fa3-94b5-5f0342bea15c tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:09.169552 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d6773e39-053a-4fa3-94b5-5f0342bea15c tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:09.170009 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d6773e39-053a-4fa3-94b5-5f0342bea15c tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:09.170772 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d6773e39-053a-4fa3-94b5-5f0342bea15c tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:09.171205 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d6773e39-053a-4fa3-94b5-5f0342bea15c tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:09.299572 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-7b2847bf-964c-4083-b088-18d5c59332ae tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:09.300082 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.network.security_group_api [None req-d6773e39-053a-4fa3-94b5-5f0342bea15c tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Removing security group b6cb02e0-6f61-4ae3-9a42-d5b44abb9622 from port eb734ba7-0de6-4766-b88e-a690cb07fd57 Nov 20 03:32:09.300233 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-7b2847bf-964c-4083-b088-18d5c59332ae tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:09.307010 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7b2847bf-964c-4083-b088-18d5c59332ae tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:09.307465 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7b2847bf-964c-4083-b088-18d5c59332ae tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:09.308275 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7b2847bf-964c-4083-b088-18d5c59332ae tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:09.308715 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7b2847bf-964c-4083-b088-18d5c59332ae tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:09.522841 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-7b2847bf-964c-4083-b088-18d5c59332ae tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:32:09.530001 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-7b2847bf-964c-4083-b088-18d5c59332ae tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1550 microversion: 2.1 time: 0.234082 Nov 20 03:32:09.530873 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 497/1065] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:32:09 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1550 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:32:09.545811 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-adb2ce71-fd02-4d52-9fdf-7b4d17854a16 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:09.546292 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-adb2ce71-fd02-4d52-9fdf-7b4d17854a16 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:09.551848 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-adb2ce71-fd02-4d52-9fdf-7b4d17854a16 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:09.552803 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-adb2ce71-fd02-4d52-9fdf-7b4d17854a16 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:09.553570 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-adb2ce71-fd02-4d52-9fdf-7b4d17854a16 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:09.554004 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-adb2ce71-fd02-4d52-9fdf-7b4d17854a16 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:09.670546 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-adb2ce71-fd02-4d52-9fdf-7b4d17854a16 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.128132 Nov 20 03:32:09.671139 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 498/1066] 10.222.0.37 () {58 vars in 1274 bytes} [Sat Nov 20 03:32:09 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/os-interface => generated 285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:32:09.758260 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-d6773e39-053a-4fa3-94b5-5f0342bea15c tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "POST /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879/action" status: 202 len: 0 microversion: 2.1 time: 0.599885 Nov 20 03:32:09.763465 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 569/1067] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:09 2021] POST /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879/action => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 03:32:09.766717 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-43bbe504-c481-4f68-bda6-501f738f2682 req-88fee950-f348-4898-bc3b-969600dfd479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f80295e-5717-4a6a-8ee2-7c0d0d3ea879", "tag": "eb734ba7-0de6-4766-b88e-a690cb07fd57"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:09.767753 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:32:09.767753 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:32:09.780080 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-43bbe504-c481-4f68-bda6-501f738f2682 req-88fee950-f348-4898-bc3b-969600dfd479 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:09.780897 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-43bbe504-c481-4f68-bda6-501f738f2682 req-88fee950-f348-4898-bc3b-969600dfd479 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:09.808908 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-43bbe504-c481-4f68-bda6-501f738f2682 req-88fee950-f348-4898-bc3b-969600dfd479 service nova] Creating event network-changed:eb734ba7-0de6-4766-b88e-a690cb07fd57 for instance 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 on hv-cinder-81803 Nov 20 03:32:09.814868 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-43bbe504-c481-4f68-bda6-501f738f2682 req-88fee950-f348-4898-bc3b-969600dfd479 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054164 Nov 20 03:32:09.815763 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 499/1068] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:32:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:32:10.705359 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-e8523b67-6ac6-44d1-bb0e-446be6bf900d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:10.706996 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-e8523b67-6ac6-44d1-bb0e-446be6bf900d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:10.707653 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-15fd4018-977d-4861-9485-da99774aeb39 req-96e516c3-1cfc-4edd-a08a-03f1b59ae550 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2109e70-6d36-409e-a430-4e36ba685082", "tag": "7404f5fe-b108-47a0-b58a-57236ae12240"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:10.710809 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:32:10.710809 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:32:10.714642 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e8523b67-6ac6-44d1-bb0e-446be6bf900d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:10.715328 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e8523b67-6ac6-44d1-bb0e-446be6bf900d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:10.717145 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e8523b67-6ac6-44d1-bb0e-446be6bf900d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:10.717700 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e8523b67-6ac6-44d1-bb0e-446be6bf900d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:10.718846 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-15fd4018-977d-4861-9485-da99774aeb39 req-96e516c3-1cfc-4edd-a08a-03f1b59ae550 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:10.719446 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-15fd4018-977d-4861-9485-da99774aeb39 req-96e516c3-1cfc-4edd-a08a-03f1b59ae550 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:10.731356 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-15fd4018-977d-4861-9485-da99774aeb39 req-96e516c3-1cfc-4edd-a08a-03f1b59ae550 service nova] Creating event network-changed:7404f5fe-b108-47a0-b58a-57236ae12240 for instance e2109e70-6d36-409e-a430-4e36ba685082 on hv-cinder-81803 Nov 20 03:32:10.737661 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-15fd4018-977d-4861-9485-da99774aeb39 req-96e516c3-1cfc-4edd-a08a-03f1b59ae550 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034244 Nov 20 03:32:10.738717 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 500/1069] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:32:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:32:10.823581 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-e8523b67-6ac6-44d1-bb0e-446be6bf900d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 14 microversion: 2.1 time: 0.123358 Nov 20 03:32:10.825650 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 570/1070] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:10 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 03:32:11.795553 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-fab3ace6-8d83-42c1-9cbd-7936e431a71c tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:11.796238 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-fab3ace6-8d83-42c1-9cbd-7936e431a71c tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:11.805986 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fab3ace6-8d83-42c1-9cbd-7936e431a71c tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:11.806579 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fab3ace6-8d83-42c1-9cbd-7936e431a71c tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:11.807759 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fab3ace6-8d83-42c1-9cbd-7936e431a71c tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:11.808441 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fab3ace6-8d83-42c1-9cbd-7936e431a71c tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:11.836774 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-6c4b264d-f26c-4562-b6f3-9af47f735c79 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:11.837794 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-6c4b264d-f26c-4562-b6f3-9af47f735c79 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:11.851451 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6c4b264d-f26c-4562-b6f3-9af47f735c79 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:11.851983 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6c4b264d-f26c-4562-b6f3-9af47f735c79 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:11.852795 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6c4b264d-f26c-4562-b6f3-9af47f735c79 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:11.853233 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6c4b264d-f26c-4562-b6f3-9af47f735c79 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:11.915128 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.objects.instance [None req-fab3ace6-8d83-42c1-9cbd-7936e431a71c tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lazy-loading 'services' on Instance uuid 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 {{(pid=116114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 03:32:11.986303 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-6c4b264d-f26c-4562-b6f3-9af47f735c79 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 14 microversion: 2.1 time: 0.153430 Nov 20 03:32:11.987443 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 571/1071] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:11 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 03:32:11.994534 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-d8bc9965-efae-438a-afe4-2c961a4c2b6b req-0bd9453b-2095-4452-ab5b-35251ac356ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f80295e-5717-4a6a-8ee2-7c0d0d3ea879", "tag": "eb734ba7-0de6-4766-b88e-a690cb07fd57"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:11.996526 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:32:11.996526 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:32:12.005515 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-d8bc9965-efae-438a-afe4-2c961a4c2b6b req-0bd9453b-2095-4452-ab5b-35251ac356ad service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:12.006402 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-d8bc9965-efae-438a-afe4-2c961a4c2b6b req-0bd9453b-2095-4452-ab5b-35251ac356ad service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:12.008703 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-fab3ace6-8d83-42c1-9cbd-7936e431a71c tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "DELETE /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879/os-volume_attachments/2076503f-58e0-46fb-b495-5d5cfa8cdfe1" status: 202 len: 0 microversion: 2.1 time: 0.219841 Nov 20 03:32:12.009635 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 501/1072] 10.222.0.37 () {58 vars in 1415 bytes} [Sat Nov 20 03:32:11 2021] DELETE /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879/os-volume_attachments/2076503f-58e0-46fb-b495-5d5cfa8cdfe1 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:32:12.019032 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-7cc284cb-36ec-4591-a010-26a8631a0e1d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:12.019556 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-d8bc9965-efae-438a-afe4-2c961a4c2b6b req-0bd9453b-2095-4452-ab5b-35251ac356ad service nova] Creating event network-changed:eb734ba7-0de6-4766-b88e-a690cb07fd57 for instance 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 on hv-cinder-81803 Nov 20 03:32:12.020486 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-7cc284cb-36ec-4591-a010-26a8631a0e1d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:12.025145 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-d8bc9965-efae-438a-afe4-2c961a4c2b6b req-0bd9453b-2095-4452-ab5b-35251ac356ad service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036092 Nov 20 03:32:12.026262 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 572/1073] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:32:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:32:12.027624 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7cc284cb-36ec-4591-a010-26a8631a0e1d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:12.028383 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7cc284cb-36ec-4591-a010-26a8631a0e1d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:12.029400 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7cc284cb-36ec-4591-a010-26a8631a0e1d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:12.030234 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7cc284cb-36ec-4591-a010-26a8631a0e1d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:12.060879 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-7cc284cb-36ec-4591-a010-26a8631a0e1d tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046867 Nov 20 03:32:12.061591 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 502/1074] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:32:12 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:32:12.998802 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-22d43968-1727-4e60-9be1-e510e5bccfa3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:12.999815 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-22d43968-1727-4e60-9be1-e510e5bccfa3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:13.005994 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-22d43968-1727-4e60-9be1-e510e5bccfa3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:13.006396 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-22d43968-1727-4e60-9be1-e510e5bccfa3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:13.007171 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-22d43968-1727-4e60-9be1-e510e5bccfa3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:13.007609 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-22d43968-1727-4e60-9be1-e510e5bccfa3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:13.072557 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-1f7887ae-0072-4ff0-9df2-fce244528099 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:13.073462 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-1f7887ae-0072-4ff0-9df2-fce244528099 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:13.079590 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1f7887ae-0072-4ff0-9df2-fce244528099 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:13.080137 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1f7887ae-0072-4ff0-9df2-fce244528099 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:13.080918 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1f7887ae-0072-4ff0-9df2-fce244528099 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:13.081337 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1f7887ae-0072-4ff0-9df2-fce244528099 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:13.086916 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-22d43968-1727-4e60-9be1-e510e5bccfa3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 14 microversion: 2.1 time: 0.092401 Nov 20 03:32:13.087821 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 573/1075] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:12 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 03:32:13.110226 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-1f7887ae-0072-4ff0-9df2-fce244528099 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041374 Nov 20 03:32:13.110768 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 503/1076] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:32:13 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 20 03:32:13.120767 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-b861cc32-0be7-49f2-89d0-20f3a7ab7eac tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:13.121357 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-b861cc32-0be7-49f2-89d0-20f3a7ab7eac tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:13.128146 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b861cc32-0be7-49f2-89d0-20f3a7ab7eac tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:13.128601 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b861cc32-0be7-49f2-89d0-20f3a7ab7eac tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:13.129378 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b861cc32-0be7-49f2-89d0-20f3a7ab7eac tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:13.129817 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b861cc32-0be7-49f2-89d0-20f3a7ab7eac tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:13.201334 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.wsgi [None req-b861cc32-0be7-49f2-89d0-20f3a7ab7eac tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] HTTP exception thrown: Instance 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 is not attached to volume 2076503f-58e0-46fb-b495-5d5cfa8cdfe1 Nov 20 03:32:13.201940 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-b861cc32-0be7-49f2-89d0-20f3a7ab7eac tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Returning 404 to user: Instance 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 is not attached to volume 2076503f-58e0-46fb-b495-5d5cfa8cdfe1 {{(pid=116113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:32:13.202757 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-b861cc32-0be7-49f2-89d0-20f3a7ab7eac tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "DELETE /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879/os-volume_attachments/2076503f-58e0-46fb-b495-5d5cfa8cdfe1" status: 404 len: 154 microversion: 2.1 time: 0.086046 Nov 20 03:32:13.203285 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 574/1077] 10.222.0.37 () {58 vars in 1415 bytes} [Sat Nov 20 03:32:13 2021] DELETE /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879/os-volume_attachments/2076503f-58e0-46fb-b495-5d5cfa8cdfe1 => generated 154 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:32:14.098274 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-4888b429-33f1-43be-8fbf-a70ce7703c65 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:14.099597 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-4888b429-33f1-43be-8fbf-a70ce7703c65 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:14.106484 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4888b429-33f1-43be-8fbf-a70ce7703c65 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:14.106942 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4888b429-33f1-43be-8fbf-a70ce7703c65 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:14.107877 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4888b429-33f1-43be-8fbf-a70ce7703c65 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:14.108424 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4888b429-33f1-43be-8fbf-a70ce7703c65 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:14.199646 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-4888b429-33f1-43be-8fbf-a70ce7703c65 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 14 microversion: 2.1 time: 0.105143 Nov 20 03:32:14.200296 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 504/1078] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:14 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 20 03:32:14.328943 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-f4db3ecf-7b7b-4ec9-b732-bcaeb20051df tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:14.329435 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f4db3ecf-7b7b-4ec9-b732-bcaeb20051df tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:14.482262 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f4db3ecf-7b7b-4ec9-b732-bcaeb20051df tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:14.482711 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f4db3ecf-7b7b-4ec9-b732-bcaeb20051df tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:14.483501 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f4db3ecf-7b7b-4ec9-b732-bcaeb20051df tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:14.483960 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f4db3ecf-7b7b-4ec9-b732-bcaeb20051df tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:14.507117 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f4db3ecf-7b7b-4ec9-b732-bcaeb20051df tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Going to try to terminate instance {{(pid=116113) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 03:32:14.576000 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-f4db3ecf-7b7b-4ec9-b732-bcaeb20051df tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "DELETE /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 204 len: 0 microversion: 2.1 time: 0.250340 Nov 20 03:32:14.576603 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 575/1079] 10.222.0.37 () {58 vars in 1238 bytes} [Sat Nov 20 03:32:14 2021] DELETE /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 03:32:14.585648 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-5d70bc0c-9e8c-4d21-ace2-9a314b45df9f tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:14.586342 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-5d70bc0c-9e8c-4d21-ace2-9a314b45df9f tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:14.593122 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5d70bc0c-9e8c-4d21-ace2-9a314b45df9f tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:14.593568 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5d70bc0c-9e8c-4d21-ace2-9a314b45df9f tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:14.594339 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5d70bc0c-9e8c-4d21-ace2-9a314b45df9f tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:14.595029 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5d70bc0c-9e8c-4d21-ace2-9a314b45df9f tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:14.726696 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-5d70bc0c-9e8c-4d21-ace2-9a314b45df9f tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:32:14.734428 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-5d70bc0c-9e8c-4d21-ace2-9a314b45df9f tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1556 microversion: 2.1 time: 0.153213 Nov 20 03:32:14.734929 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 505/1080] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:32:14 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:32:15.211405 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-381eac85-1bc2-4ae9-a700-bc080cb09c68 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:15.212496 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-381eac85-1bc2-4ae9-a700-bc080cb09c68 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:15.218709 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-381eac85-1bc2-4ae9-a700-bc080cb09c68 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:15.219160 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-381eac85-1bc2-4ae9-a700-bc080cb09c68 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:15.220237 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-381eac85-1bc2-4ae9-a700-bc080cb09c68 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:15.220668 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-381eac85-1bc2-4ae9-a700-bc080cb09c68 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:15.306718 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-381eac85-1bc2-4ae9-a700-bc080cb09c68 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 14 microversion: 2.1 time: 0.099742 Nov 20 03:32:15.307234 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 576/1081] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:15 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 03:32:15.751331 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-418dcaee-5554-4623-a2b2-7f5a568fed56 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:15.751965 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-418dcaee-5554-4623-a2b2-7f5a568fed56 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:15.758249 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-418dcaee-5554-4623-a2b2-7f5a568fed56 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:15.758689 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-418dcaee-5554-4623-a2b2-7f5a568fed56 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:15.759448 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-418dcaee-5554-4623-a2b2-7f5a568fed56 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:15.759907 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-418dcaee-5554-4623-a2b2-7f5a568fed56 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:15.887997 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-418dcaee-5554-4623-a2b2-7f5a568fed56 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:32:15.895619 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-418dcaee-5554-4623-a2b2-7f5a568fed56 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1556 microversion: 2.1 time: 0.147968 Nov 20 03:32:15.896451 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 506/1082] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:32:15 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1556 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:32:16.318697 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-9cbd90ce-3a61-4f78-b7e0-54a4381778b9 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:16.319696 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-9cbd90ce-3a61-4f78-b7e0-54a4381778b9 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:16.326460 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9cbd90ce-3a61-4f78-b7e0-54a4381778b9 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:16.326906 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9cbd90ce-3a61-4f78-b7e0-54a4381778b9 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:16.327680 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9cbd90ce-3a61-4f78-b7e0-54a4381778b9 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:16.328146 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9cbd90ce-3a61-4f78-b7e0-54a4381778b9 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:16.415139 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-9cbd90ce-3a61-4f78-b7e0-54a4381778b9 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 14 microversion: 2.1 time: 0.100767 Nov 20 03:32:16.415755 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 577/1083] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:16 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 03:32:16.912347 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-36b3015b-db92-4dc8-947e-c4190c1e6bf4 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:16.912966 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-36b3015b-db92-4dc8-947e-c4190c1e6bf4 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:16.919230 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-36b3015b-db92-4dc8-947e-c4190c1e6bf4 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:16.919679 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-36b3015b-db92-4dc8-947e-c4190c1e6bf4 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:16.920500 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-36b3015b-db92-4dc8-947e-c4190c1e6bf4 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:16.920955 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-36b3015b-db92-4dc8-947e-c4190c1e6bf4 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:17.012069 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-36b3015b-db92-4dc8-947e-c4190c1e6bf4 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5079359cad0342bfbefd6c33f39a93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53d3d6966164babbb24206f254ee2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:32:17.019565 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-36b3015b-db92-4dc8-947e-c4190c1e6bf4 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 200 len: 1514 microversion: 2.1 time: 0.110954 Nov 20 03:32:17.020452 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 507/1084] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:32:16 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 1514 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:32:17.044543 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-431a4130-e4da-4357-a279-548c871310c4 req-939bc21f-a4fa-4c67-91db-e85247a1a49f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f80295e-5717-4a6a-8ee2-7c0d0d3ea879", "name": "network-vif-deleted", "tag": "eb734ba7-0de6-4766-b88e-a690cb07fd57"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:17.046109 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:32:17.046109 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:32:17.054996 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-431a4130-e4da-4357-a279-548c871310c4 req-939bc21f-a4fa-4c67-91db-e85247a1a49f service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:17.055438 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-431a4130-e4da-4357-a279-548c871310c4 req-939bc21f-a4fa-4c67-91db-e85247a1a49f service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:17.069514 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-431a4130-e4da-4357-a279-548c871310c4 req-939bc21f-a4fa-4c67-91db-e85247a1a49f service nova] Creating event network-vif-deleted:eb734ba7-0de6-4766-b88e-a690cb07fd57 for instance 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 on hv-cinder-81803 Nov 20 03:32:17.075850 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-431a4130-e4da-4357-a279-548c871310c4 req-939bc21f-a4fa-4c67-91db-e85247a1a49f service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035257 Nov 20 03:32:17.076434 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 578/1085] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:32:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:32:17.425371 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-1bb1862b-667e-4f06-a7b5-9ad652b3e497 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:17.426393 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-1bb1862b-667e-4f06-a7b5-9ad652b3e497 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:17.433909 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1bb1862b-667e-4f06-a7b5-9ad652b3e497 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:17.434360 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1bb1862b-667e-4f06-a7b5-9ad652b3e497 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:17.435149 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1bb1862b-667e-4f06-a7b5-9ad652b3e497 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:17.435585 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1bb1862b-667e-4f06-a7b5-9ad652b3e497 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:17.524252 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-1bb1862b-667e-4f06-a7b5-9ad652b3e497 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 14 microversion: 2.1 time: 0.102369 Nov 20 03:32:17.524891 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 508/1086] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:17 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 03:32:18.037363 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-e2d9be31-1058-4d03-a9f0-bbd6b1475a80 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:18.038069 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-e2d9be31-1058-4d03-a9f0-bbd6b1475a80 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] [instance: 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:18.044580 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e2d9be31-1058-4d03-a9f0-bbd6b1475a80 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:18.045035 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e2d9be31-1058-4d03-a9f0-bbd6b1475a80 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:18.045823 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e2d9be31-1058-4d03-a9f0-bbd6b1475a80 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:18.046260 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e2d9be31-1058-4d03-a9f0-bbd6b1475a80 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:18.059357 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.wsgi [None req-e2d9be31-1058-4d03-a9f0-bbd6b1475a80 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] HTTP exception thrown: Instance 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 could not be found. Nov 20 03:32:18.059970 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-e2d9be31-1058-4d03-a9f0-bbd6b1475a80 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Returning 404 to user: Instance 0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 could not be found. {{(pid=116113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:32:18.060778 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-e2d9be31-1058-4d03-a9f0-bbd6b1475a80 tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879" status: 404 len: 111 microversion: 2.1 time: 0.027680 Nov 20 03:32:18.061284 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 579/1087] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:32:18 2021] GET /compute/v2.1/servers/0f80295e-5717-4a6a-8ee2-7c0d0d3ea879 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:32:18.070537 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-62b1e2cf-a872-49e5-8bb3-f6004eb373da tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] Calling method '.version_select at 0x7f2dac76c940>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:18.087436 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-62b1e2cf-a872-49e5-8bb3-f6004eb373da tempest-TestMinimumBasicScenario-401886780 tempest-TestMinimumBasicScenario-401886780-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1301509369" status: 202 len: 0 microversion: 2.1 time: 0.021592 Nov 20 03:32:18.088180 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 509/1088] 10.222.0.37 () {58 vars in 1271 bytes} [Sat Nov 20 03:32:18 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1301509369 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:32:18.535388 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-d74632e5-d60e-43c0-ad25-487dca76fffc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:18.536348 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-d74632e5-d60e-43c0-ad25-487dca76fffc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:18.542559 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d74632e5-d60e-43c0-ad25-487dca76fffc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:18.543016 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d74632e5-d60e-43c0-ad25-487dca76fffc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:18.543806 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d74632e5-d60e-43c0-ad25-487dca76fffc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:18.544284 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-d74632e5-d60e-43c0-ad25-487dca76fffc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:18.626278 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-d74632e5-d60e-43c0-ad25-487dca76fffc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 14 microversion: 2.1 time: 0.094579 Nov 20 03:32:18.629852 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 580/1089] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:18 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 03:32:19.638125 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-e605e915-3ad4-4a40-923d-055ed023e879 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:19.640210 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-e605e915-3ad4-4a40-923d-055ed023e879 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:19.647015 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e605e915-3ad4-4a40-923d-055ed023e879 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:19.647773 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e605e915-3ad4-4a40-923d-055ed023e879 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:19.648844 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e605e915-3ad4-4a40-923d-055ed023e879 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:19.649353 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e605e915-3ad4-4a40-923d-055ed023e879 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:19.736850 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-e605e915-3ad4-4a40-923d-055ed023e879 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 14 microversion: 2.1 time: 0.102662 Nov 20 03:32:19.739935 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 510/1090] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:19 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 03:32:20.747663 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-8f4113f6-4e54-4986-9127-6ee7f5732e27 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:20.748750 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-8f4113f6-4e54-4986-9127-6ee7f5732e27 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:20.755694 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8f4113f6-4e54-4986-9127-6ee7f5732e27 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:20.756201 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8f4113f6-4e54-4986-9127-6ee7f5732e27 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:20.756989 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8f4113f6-4e54-4986-9127-6ee7f5732e27 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:20.757594 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8f4113f6-4e54-4986-9127-6ee7f5732e27 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:20.842747 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-8f4113f6-4e54-4986-9127-6ee7f5732e27 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 14 microversion: 2.1 time: 0.099107 Nov 20 03:32:20.843520 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 581/1091] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:20 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 03:32:21.856442 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-d6097c06-73bc-4700-9b2d-1650b14b43cb tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:21.857642 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-d6097c06-73bc-4700-9b2d-1650b14b43cb tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:21.870200 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d6097c06-73bc-4700-9b2d-1650b14b43cb tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:21.870657 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d6097c06-73bc-4700-9b2d-1650b14b43cb tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:21.871451 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d6097c06-73bc-4700-9b2d-1650b14b43cb tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:21.871919 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d6097c06-73bc-4700-9b2d-1650b14b43cb tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:21.976737 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-d6097c06-73bc-4700-9b2d-1650b14b43cb tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 8173 microversion: 2.1 time: 0.124349 Nov 20 03:32:21.977389 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 511/1092] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:21 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 8173 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:32:22.988438 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-33c923e9-53e3-41cb-8269-ac7b2fba5a8e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:22.989366 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-33c923e9-53e3-41cb-8269-ac7b2fba5a8e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:22.996760 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-33c923e9-53e3-41cb-8269-ac7b2fba5a8e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:22.997218 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-33c923e9-53e3-41cb-8269-ac7b2fba5a8e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:22.998043 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-33c923e9-53e3-41cb-8269-ac7b2fba5a8e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:22.998442 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-33c923e9-53e3-41cb-8269-ac7b2fba5a8e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:23.088244 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-33c923e9-53e3-41cb-8269-ac7b2fba5a8e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 16280 microversion: 2.1 time: 0.103733 Nov 20 03:32:23.089040 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 582/1093] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:22 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 16280 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:32:24.100199 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-d2640b90-4474-4766-8f18-28dec694fb77 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:24.101273 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-d2640b90-4474-4766-8f18-28dec694fb77 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:24.108135 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d2640b90-4474-4766-8f18-28dec694fb77 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:24.108640 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d2640b90-4474-4766-8f18-28dec694fb77 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:24.109416 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d2640b90-4474-4766-8f18-28dec694fb77 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:24.109849 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d2640b90-4474-4766-8f18-28dec694fb77 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:24.214777 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-d2640b90-4474-4766-8f18-28dec694fb77 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 18498 microversion: 2.1 time: 0.117198 Nov 20 03:32:24.219329 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 512/1094] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:24 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 18498 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:32:25.227579 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ff4b9e03-91ab-4554-86f3-4fdbd3f4323b tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:25.228744 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ff4b9e03-91ab-4554-86f3-4fdbd3f4323b tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:25.235467 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ff4b9e03-91ab-4554-86f3-4fdbd3f4323b tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:25.235974 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ff4b9e03-91ab-4554-86f3-4fdbd3f4323b tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:25.236755 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ff4b9e03-91ab-4554-86f3-4fdbd3f4323b tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:25.237198 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ff4b9e03-91ab-4554-86f3-4fdbd3f4323b tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:25.328362 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ff4b9e03-91ab-4554-86f3-4fdbd3f4323b tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 20997 microversion: 2.1 time: 0.105265 Nov 20 03:32:25.329002 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 583/1095] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:25 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 20997 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:32:26.340837 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-fa15a23e-dab3-48a6-936c-221bfab784e5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:26.341870 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-fa15a23e-dab3-48a6-936c-221bfab784e5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:26.348988 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fa15a23e-dab3-48a6-936c-221bfab784e5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:26.349443 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fa15a23e-dab3-48a6-936c-221bfab784e5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:26.350227 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fa15a23e-dab3-48a6-936c-221bfab784e5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:26.350665 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fa15a23e-dab3-48a6-936c-221bfab784e5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:26.439453 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-fa15a23e-dab3-48a6-936c-221bfab784e5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 22949 microversion: 2.1 time: 0.102518 Nov 20 03:32:26.440089 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 513/1096] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:26 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 22949 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:32:27.451899 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-f460ca23-0cc7-4f7a-acb5-92665e3749eb tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:27.452926 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f460ca23-0cc7-4f7a-acb5-92665e3749eb tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:27.460172 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f460ca23-0cc7-4f7a-acb5-92665e3749eb tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:27.460622 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f460ca23-0cc7-4f7a-acb5-92665e3749eb tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:27.461386 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f460ca23-0cc7-4f7a-acb5-92665e3749eb tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:27.461818 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f460ca23-0cc7-4f7a-acb5-92665e3749eb tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:27.547816 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-f460ca23-0cc7-4f7a-acb5-92665e3749eb tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 24305 microversion: 2.1 time: 0.099794 Nov 20 03:32:27.548488 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 584/1097] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:27 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 24305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 03:32:28.560593 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-41b51af7-1e5c-45a8-b0bb-d91a2fa4b689 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:28.561511 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-41b51af7-1e5c-45a8-b0bb-d91a2fa4b689 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:28.568382 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-41b51af7-1e5c-45a8-b0bb-d91a2fa4b689 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:28.568836 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-41b51af7-1e5c-45a8-b0bb-d91a2fa4b689 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:28.569619 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-41b51af7-1e5c-45a8-b0bb-d91a2fa4b689 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:28.570056 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-41b51af7-1e5c-45a8-b0bb-d91a2fa4b689 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:28.659646 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-41b51af7-1e5c-45a8-b0bb-d91a2fa4b689 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 25940 microversion: 2.1 time: 0.102986 Nov 20 03:32:28.660343 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 514/1098] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:28 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 25940 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:32:29.672250 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-7d50cc12-41ca-45b5-9870-7816106032fa tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:29.673252 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-7d50cc12-41ca-45b5-9870-7816106032fa tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:29.680800 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7d50cc12-41ca-45b5-9870-7816106032fa tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:29.681256 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7d50cc12-41ca-45b5-9870-7816106032fa tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:29.682038 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7d50cc12-41ca-45b5-9870-7816106032fa tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:29.682480 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7d50cc12-41ca-45b5-9870-7816106032fa tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:29.775740 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-7d50cc12-41ca-45b5-9870-7816106032fa tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 27162 microversion: 2.1 time: 0.107637 Nov 20 03:32:29.776381 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 585/1099] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:29 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 27162 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 03:32:30.788518 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-5ca55df9-f7f1-474a-8592-bb1509f5df5b tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:30.789519 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-5ca55df9-f7f1-474a-8592-bb1509f5df5b tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:30.796388 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5ca55df9-f7f1-474a-8592-bb1509f5df5b tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:30.796841 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5ca55df9-f7f1-474a-8592-bb1509f5df5b tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:30.797621 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5ca55df9-f7f1-474a-8592-bb1509f5df5b tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:30.798059 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5ca55df9-f7f1-474a-8592-bb1509f5df5b tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:30.890508 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-5ca55df9-f7f1-474a-8592-bb1509f5df5b tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 27915 microversion: 2.1 time: 0.106359 Nov 20 03:32:30.891195 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 515/1100] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:30 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 27915 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:32:31.901741 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-b7d83ba4-a83c-4aa1-8ec3-117d6cb3f60c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:31.902790 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-b7d83ba4-a83c-4aa1-8ec3-117d6cb3f60c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:31.909559 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b7d83ba4-a83c-4aa1-8ec3-117d6cb3f60c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:31.910006 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b7d83ba4-a83c-4aa1-8ec3-117d6cb3f60c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:31.910770 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b7d83ba4-a83c-4aa1-8ec3-117d6cb3f60c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:31.911199 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b7d83ba4-a83c-4aa1-8ec3-117d6cb3f60c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:32.001662 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-b7d83ba4-a83c-4aa1-8ec3-117d6cb3f60c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 28218 microversion: 2.1 time: 0.103792 Nov 20 03:32:32.002443 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 586/1101] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:31 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 28218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:32:33.014408 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-b92f8b6d-47d4-49f7-a2f4-829bf9a72575 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:33.015410 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-b92f8b6d-47d4-49f7-a2f4-829bf9a72575 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:33.022856 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b92f8b6d-47d4-49f7-a2f4-829bf9a72575 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:33.023308 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b92f8b6d-47d4-49f7-a2f4-829bf9a72575 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:33.024118 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b92f8b6d-47d4-49f7-a2f4-829bf9a72575 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:33.024558 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b92f8b6d-47d4-49f7-a2f4-829bf9a72575 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:33.108624 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-b92f8b6d-47d4-49f7-a2f4-829bf9a72575 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 28218 microversion: 2.1 time: 0.098040 Nov 20 03:32:33.109465 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 516/1102] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:33 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 28218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:32:34.120593 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-5cb2c9e1-fa68-400f-8c57-e8ad06c86d42 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:34.121624 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-5cb2c9e1-fa68-400f-8c57-e8ad06c86d42 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:34.128464 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5cb2c9e1-fa68-400f-8c57-e8ad06c86d42 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:34.128916 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5cb2c9e1-fa68-400f-8c57-e8ad06c86d42 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:34.129691 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5cb2c9e1-fa68-400f-8c57-e8ad06c86d42 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:34.130126 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5cb2c9e1-fa68-400f-8c57-e8ad06c86d42 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:34.226687 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-5cb2c9e1-fa68-400f-8c57-e8ad06c86d42 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 28509 microversion: 2.1 time: 0.109944 Nov 20 03:32:34.227240 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 587/1103] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:34 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 28509 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 03:32:35.238792 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-e165c914-c1fe-4927-8d32-33e3158621cc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:35.239697 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-e165c914-c1fe-4927-8d32-33e3158621cc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:35.249066 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e165c914-c1fe-4927-8d32-33e3158621cc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:35.249510 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e165c914-c1fe-4927-8d32-33e3158621cc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:35.250286 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e165c914-c1fe-4927-8d32-33e3158621cc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:35.250713 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e165c914-c1fe-4927-8d32-33e3158621cc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:35.343368 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-e165c914-c1fe-4927-8d32-33e3158621cc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 28677 microversion: 2.1 time: 0.108527 Nov 20 03:32:35.344062 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 517/1104] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:35 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 28677 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:32:36.356412 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-eff797f0-4036-4e26-8cf8-556eaad3c09f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:36.357394 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-eff797f0-4036-4e26-8cf8-556eaad3c09f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:36.364160 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-eff797f0-4036-4e26-8cf8-556eaad3c09f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:36.364608 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-eff797f0-4036-4e26-8cf8-556eaad3c09f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:36.365704 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-eff797f0-4036-4e26-8cf8-556eaad3c09f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:36.366336 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-eff797f0-4036-4e26-8cf8-556eaad3c09f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:36.454744 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-eff797f0-4036-4e26-8cf8-556eaad3c09f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 28677 microversion: 2.1 time: 0.102093 Nov 20 03:32:36.455383 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 588/1105] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:36 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 28677 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:32:37.466778 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-dee0585a-f39f-4713-8bd6-b22af44ee03a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:37.467767 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-dee0585a-f39f-4713-8bd6-b22af44ee03a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:37.474991 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dee0585a-f39f-4713-8bd6-b22af44ee03a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:37.475974 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dee0585a-f39f-4713-8bd6-b22af44ee03a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:37.476752 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dee0585a-f39f-4713-8bd6-b22af44ee03a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:37.477181 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-dee0585a-f39f-4713-8bd6-b22af44ee03a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:37.564695 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-dee0585a-f39f-4713-8bd6-b22af44ee03a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 28677 microversion: 2.1 time: 0.101765 Nov 20 03:32:37.567860 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 518/1106] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:37 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 28677 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:32:38.576615 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-69933ef4-b27e-42b7-8cea-9e9bd6849901 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:38.577538 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-69933ef4-b27e-42b7-8cea-9e9bd6849901 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:38.584352 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-69933ef4-b27e-42b7-8cea-9e9bd6849901 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:38.585324 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-69933ef4-b27e-42b7-8cea-9e9bd6849901 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:38.586088 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-69933ef4-b27e-42b7-8cea-9e9bd6849901 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:38.586516 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-69933ef4-b27e-42b7-8cea-9e9bd6849901 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:38.679406 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-69933ef4-b27e-42b7-8cea-9e9bd6849901 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 29599 microversion: 2.1 time: 0.106701 Nov 20 03:32:38.680061 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 589/1107] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:38 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 29599 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:32:39.691989 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-c0b9b9de-9743-497a-b112-5af6e80b13ce tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:39.692979 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-c0b9b9de-9743-497a-b112-5af6e80b13ce tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:39.699899 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c0b9b9de-9743-497a-b112-5af6e80b13ce tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:39.700347 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c0b9b9de-9743-497a-b112-5af6e80b13ce tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:39.701112 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c0b9b9de-9743-497a-b112-5af6e80b13ce tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:39.701544 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-c0b9b9de-9743-497a-b112-5af6e80b13ce tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:39.793548 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-c0b9b9de-9743-497a-b112-5af6e80b13ce tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 31806 microversion: 2.1 time: 0.105798 Nov 20 03:32:39.794418 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 519/1108] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:39 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 31806 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:32:40.806531 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-1c06b72c-3b2a-4c8a-8a09-14577a046126 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:40.807549 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-1c06b72c-3b2a-4c8a-8a09-14577a046126 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:40.814381 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1c06b72c-3b2a-4c8a-8a09-14577a046126 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:40.814825 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1c06b72c-3b2a-4c8a-8a09-14577a046126 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:40.815592 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1c06b72c-3b2a-4c8a-8a09-14577a046126 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:40.816046 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1c06b72c-3b2a-4c8a-8a09-14577a046126 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:40.904295 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-1c06b72c-3b2a-4c8a-8a09-14577a046126 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 33357 microversion: 2.1 time: 0.102032 Nov 20 03:32:40.904935 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 590/1109] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:40 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 33357 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:32:41.916328 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-2790b5e9-ffd2-48eb-9742-9dea61437f4a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:41.917309 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-2790b5e9-ffd2-48eb-9742-9dea61437f4a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:41.924210 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2790b5e9-ffd2-48eb-9742-9dea61437f4a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:41.924660 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2790b5e9-ffd2-48eb-9742-9dea61437f4a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:41.925428 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2790b5e9-ffd2-48eb-9742-9dea61437f4a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:41.925859 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2790b5e9-ffd2-48eb-9742-9dea61437f4a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:42.023137 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-2790b5e9-ffd2-48eb-9742-9dea61437f4a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 34415 microversion: 2.1 time: 0.110040 Nov 20 03:32:42.023840 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 520/1110] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:41 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 34415 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:32:43.034796 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-5e2dcb3e-68a6-432a-b94e-721984bd81e4 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:43.035816 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-5e2dcb3e-68a6-432a-b94e-721984bd81e4 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:43.043335 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5e2dcb3e-68a6-432a-b94e-721984bd81e4 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:43.043806 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5e2dcb3e-68a6-432a-b94e-721984bd81e4 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:43.044578 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5e2dcb3e-68a6-432a-b94e-721984bd81e4 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:43.045037 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-5e2dcb3e-68a6-432a-b94e-721984bd81e4 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:45.103275 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-5e2dcb3e-68a6-432a-b94e-721984bd81e4 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 38142 microversion: 2.1 time: 2.072308 Nov 20 03:32:45.104027 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 591/1111] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:43 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 38142 bytes in 2074 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:32:46.115645 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-1c4c217d-1261-497e-a40a-82c084c3519d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:46.116685 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-1c4c217d-1261-497e-a40a-82c084c3519d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:46.123528 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1c4c217d-1261-497e-a40a-82c084c3519d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:46.124020 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1c4c217d-1261-497e-a40a-82c084c3519d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:46.124791 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1c4c217d-1261-497e-a40a-82c084c3519d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:46.125231 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1c4c217d-1261-497e-a40a-82c084c3519d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:46.221207 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-1c4c217d-1261-497e-a40a-82c084c3519d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 38212 microversion: 2.1 time: 0.109318 Nov 20 03:32:46.222040 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 521/1112] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:46 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 38212 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:32:47.234081 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-695e956f-0e09-4a9a-9aa8-c4103ee9acfa tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:47.234997 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-695e956f-0e09-4a9a-9aa8-c4103ee9acfa tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:47.242881 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-695e956f-0e09-4a9a-9aa8-c4103ee9acfa tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:47.243322 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-695e956f-0e09-4a9a-9aa8-c4103ee9acfa tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:47.244116 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-695e956f-0e09-4a9a-9aa8-c4103ee9acfa tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:47.244550 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-695e956f-0e09-4a9a-9aa8-c4103ee9acfa tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:47.329482 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-695e956f-0e09-4a9a-9aa8-c4103ee9acfa tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 38212 microversion: 2.1 time: 0.099432 Nov 20 03:32:47.330101 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 592/1113] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:47 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 38212 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:32:48.341772 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-892dc5f3-0d47-48bb-92b2-292bfdbac2e0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:48.342756 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-892dc5f3-0d47-48bb-92b2-292bfdbac2e0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:48.349812 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-892dc5f3-0d47-48bb-92b2-292bfdbac2e0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:48.350256 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-892dc5f3-0d47-48bb-92b2-292bfdbac2e0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:48.351103 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-892dc5f3-0d47-48bb-92b2-292bfdbac2e0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:48.351539 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-892dc5f3-0d47-48bb-92b2-292bfdbac2e0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:48.437651 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-892dc5f3-0d47-48bb-92b2-292bfdbac2e0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 38212 microversion: 2.1 time: 0.099823 Nov 20 03:32:48.438275 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 522/1114] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:48 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 38212 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:32:49.450071 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-cc9f1246-34e3-4391-9f6f-7380d8ac0f35 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:49.451072 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-cc9f1246-34e3-4391-9f6f-7380d8ac0f35 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:49.457924 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cc9f1246-34e3-4391-9f6f-7380d8ac0f35 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:49.458380 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cc9f1246-34e3-4391-9f6f-7380d8ac0f35 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:49.460747 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cc9f1246-34e3-4391-9f6f-7380d8ac0f35 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:49.460747 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cc9f1246-34e3-4391-9f6f-7380d8ac0f35 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:49.551089 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-cc9f1246-34e3-4391-9f6f-7380d8ac0f35 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 200 len: 38343 microversion: 2.1 time: 0.104973 Nov 20 03:32:49.551709 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 593/1115] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:49 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 38343 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:32:49.562497 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-3151add6-e1d1-4a10-b9ac-051de01b0114 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:49.563074 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-3151add6-e1d1-4a10-b9ac-051de01b0114 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:49.569870 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3151add6-e1d1-4a10-b9ac-051de01b0114 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:49.570313 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3151add6-e1d1-4a10-b9ac-051de01b0114 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:49.571086 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3151add6-e1d1-4a10-b9ac-051de01b0114 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:49.571517 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3151add6-e1d1-4a10-b9ac-051de01b0114 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:49.597702 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-3151add6-e1d1-4a10-b9ac-051de01b0114 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/ips" status: 200 len: 147 microversion: 2.1 time: 0.039177 Nov 20 03:32:49.598298 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 523/1116] 10.222.0.37 () {58 vars in 1247 bytes} [Sat Nov 20 03:32:49 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:32:49.747973 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-47f67805-3b6e-47b1-8929-2f73c9716d2b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-369307293", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2111923564", "security_groups": [{"name": "tempest-secgroup-smoke-1311371933"}], "block_device_mapping_v2": [{"uuid": "bdf391c9-e754-4dd0-9618-2997b54895f6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "47f51dd2-9655-4765-8747-cb254c8e5525"}]}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:49.856214 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.network.neutron [None req-47f67805-3b6e-47b1-8929-2f73c9716d2b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] validate_networks() for [('47f51dd2-9655-4765-8747-cb254c8e5525', None, None, None, None, None)] {{(pid=116113) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 03:32:50.218947 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-47f67805-3b6e-47b1-8929-2f73c9716d2b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Flavor limits 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 03:32:50.219709 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-47f67805-3b6e-47b1-8929-2f73c9716d2b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Image limits 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 03:32:50.220180 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-47f67805-3b6e-47b1-8929-2f73c9716d2b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Flavor pref 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 03:32:50.220807 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-47f67805-3b6e-47b1-8929-2f73c9716d2b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Image pref 0:0:0 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 03:32:50.221217 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.virt.hardware [None req-47f67805-3b6e-47b1-8929-2f73c9716d2b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 03:32:50.230174 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-47f67805-3b6e-47b1-8929-2f73c9716d2b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:50.230620 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-47f67805-3b6e-47b1-8929-2f73c9716d2b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:50.231433 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-47f67805-3b6e-47b1-8929-2f73c9716d2b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:50.231913 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-47f67805-3b6e-47b1-8929-2f73c9716d2b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:50.248038 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-47f67805-3b6e-47b1-8929-2f73c9716d2b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Getting quotas for project ee28f54d912d4789b1b0abf0f0cddab5. Resources: {'ram', 'cores', 'instances'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:32:50.251879 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-47f67805-3b6e-47b1-8929-2f73c9716d2b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Getting quotas for user 2841384d235c4869bc6c39212c34f0f9 and project ee28f54d912d4789b1b0abf0f0cddab5. Resources: {'ram', 'cores', 'instances'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:32:50.305508 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-47f67805-3b6e-47b1-8929-2f73c9716d2b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Going to run 1 instances... {{(pid=116113) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 03:32:50.307707 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-47f67805-3b6e-47b1-8929-2f73c9716d2b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: dd695701-5d21-42e3-b21d-2e6069ea2c67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bdf391c9-e754-4dd0-9618-2997b54895f6',volume_size=None,volume_type=None)] {{(pid=116113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 03:32:50.424626 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-47f67805-3b6e-47b1-8929-2f73c9716d2b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.680648 Nov 20 03:32:50.425271 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 594/1117] 10.222.0.37 () {60 vars in 1146 bytes} [Sat Nov 20 03:32:49 2021] POST /compute/v2.1/servers => generated 406 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 03:32:50.435357 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-d85617dc-c91d-4383-b000-6e1cdb4392a3 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:50.436008 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-d85617dc-c91d-4383-b000-6e1cdb4392a3 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: dd695701-5d21-42e3-b21d-2e6069ea2c67] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:50.489471 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-d85617dc-c91d-4383-b000-6e1cdb4392a3 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:32:50.496548 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-d85617dc-c91d-4383-b000-6e1cdb4392a3 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67" status: 200 len: 1094 microversion: 2.1 time: 0.064835 Nov 20 03:32:50.497115 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 524/1118] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:32:50 2021] GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:32:51.515035 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-1996cdca-6a75-44d6-9991-6f3006ee8c3a tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:51.515617 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-1996cdca-6a75-44d6-9991-6f3006ee8c3a tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: dd695701-5d21-42e3-b21d-2e6069ea2c67] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:51.522814 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1996cdca-6a75-44d6-9991-6f3006ee8c3a tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:51.523271 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1996cdca-6a75-44d6-9991-6f3006ee8c3a tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:51.524124 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1996cdca-6a75-44d6-9991-6f3006ee8c3a tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:51.524548 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1996cdca-6a75-44d6-9991-6f3006ee8c3a tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:51.585800 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-1996cdca-6a75-44d6-9991-6f3006ee8c3a tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:32:51.593883 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-1996cdca-6a75-44d6-9991-6f3006ee8c3a tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67" status: 200 len: 1200 microversion: 2.1 time: 0.083578 Nov 20 03:32:51.596085 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 595/1119] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:32:51 2021] GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67 => generated 1200 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:32:51.903135 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-76373806-48e7-4b01-8185-22e1c781657d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fdfb191c-46af-4bd1-a958-5255a76373db"}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:51.904206 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-76373806-48e7-4b01-8185-22e1c781657d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:51.911239 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-76373806-48e7-4b01-8185-22e1c781657d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:51.911685 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-76373806-48e7-4b01-8185-22e1c781657d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:51.912526 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-76373806-48e7-4b01-8185-22e1c781657d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:51.912959 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-76373806-48e7-4b01-8185-22e1c781657d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:52.169148 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-76373806-48e7-4b01-8185-22e1c781657d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269360 Nov 20 03:32:52.169760 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 525/1120] 10.222.0.37 () {60 vars in 1322 bytes} [Sat Nov 20 03:32:51 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:32:52.610773 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-4212b2f5-112c-4c96-980d-dc00b8ee27be tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:52.611398 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-4212b2f5-112c-4c96-980d-dc00b8ee27be tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: dd695701-5d21-42e3-b21d-2e6069ea2c67] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:52.618651 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4212b2f5-112c-4c96-980d-dc00b8ee27be tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:52.619100 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4212b2f5-112c-4c96-980d-dc00b8ee27be tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:52.620132 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4212b2f5-112c-4c96-980d-dc00b8ee27be tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:52.620567 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4212b2f5-112c-4c96-980d-dc00b8ee27be tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:52.853252 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-4212b2f5-112c-4c96-980d-dc00b8ee27be tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:32:52.860616 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-4212b2f5-112c-4c96-980d-dc00b8ee27be tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67" status: 200 len: 1266 microversion: 2.1 time: 0.253687 Nov 20 03:32:52.861186 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 596/1121] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:32:52 2021] GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67 => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:32:53.330325 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-c916c3a0-a2a3-4085-b9b2-76d7a8e11a26 req-82b4d3a1-5ac8-4b9e-ba1b-47e7582b759f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd695701-5d21-42e3-b21d-2e6069ea2c67", "tag": "b1b6c435-4da9-495a-9684-c863636515b2"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:53.332571 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:32:53.332571 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:32:53.341365 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-c916c3a0-a2a3-4085-b9b2-76d7a8e11a26 req-82b4d3a1-5ac8-4b9e-ba1b-47e7582b759f service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:53.342081 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-c916c3a0-a2a3-4085-b9b2-76d7a8e11a26 req-82b4d3a1-5ac8-4b9e-ba1b-47e7582b759f service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:53.354074 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-c916c3a0-a2a3-4085-b9b2-76d7a8e11a26 req-82b4d3a1-5ac8-4b9e-ba1b-47e7582b759f service nova] Creating event network-changed:b1b6c435-4da9-495a-9684-c863636515b2 for instance dd695701-5d21-42e3-b21d-2e6069ea2c67 on hv-cinder-81803 Nov 20 03:32:53.360185 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-c916c3a0-a2a3-4085-b9b2-76d7a8e11a26 req-82b4d3a1-5ac8-4b9e-ba1b-47e7582b759f service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034075 Nov 20 03:32:53.361357 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 526/1122] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:32:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:32:53.877488 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-58be9cc0-58c3-4613-9f8b-2757c54cf50f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:53.878099 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-58be9cc0-58c3-4613-9f8b-2757c54cf50f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: dd695701-5d21-42e3-b21d-2e6069ea2c67] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:53.884905 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-58be9cc0-58c3-4613-9f8b-2757c54cf50f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:53.885355 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-58be9cc0-58c3-4613-9f8b-2757c54cf50f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:53.886129 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-58be9cc0-58c3-4613-9f8b-2757c54cf50f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:53.886568 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-58be9cc0-58c3-4613-9f8b-2757c54cf50f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:54.135564 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-58be9cc0-58c3-4613-9f8b-2757c54cf50f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:32:54.142829 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-58be9cc0-58c3-4613-9f8b-2757c54cf50f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67" status: 200 len: 1266 microversion: 2.1 time: 0.269016 Nov 20 03:32:54.143398 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 597/1123] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:32:53 2021] GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67 => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:32:55.160853 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-fdafff54-91b9-42dd-8406-b14d8b8a0f5f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:55.161555 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-fdafff54-91b9-42dd-8406-b14d8b8a0f5f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: dd695701-5d21-42e3-b21d-2e6069ea2c67] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:55.168234 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fdafff54-91b9-42dd-8406-b14d8b8a0f5f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:55.168686 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fdafff54-91b9-42dd-8406-b14d8b8a0f5f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:55.169467 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fdafff54-91b9-42dd-8406-b14d8b8a0f5f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:55.169905 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fdafff54-91b9-42dd-8406-b14d8b8a0f5f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:55.302368 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-fdafff54-91b9-42dd-8406-b14d8b8a0f5f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:32:55.309646 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-fdafff54-91b9-42dd-8406-b14d8b8a0f5f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67" status: 200 len: 1266 microversion: 2.1 time: 0.153269 Nov 20 03:32:55.310216 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 527/1124] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:32:55 2021] GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:32:56.326523 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-ccfb75f1-5707-4c7b-a8ae-31cf3b3dc5ec tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:56.327137 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-ccfb75f1-5707-4c7b-a8ae-31cf3b3dc5ec tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: dd695701-5d21-42e3-b21d-2e6069ea2c67] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:56.333460 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ccfb75f1-5707-4c7b-a8ae-31cf3b3dc5ec tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:56.333916 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ccfb75f1-5707-4c7b-a8ae-31cf3b3dc5ec tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:56.334693 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ccfb75f1-5707-4c7b-a8ae-31cf3b3dc5ec tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:56.335129 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-ccfb75f1-5707-4c7b-a8ae-31cf3b3dc5ec tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:56.464321 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-ccfb75f1-5707-4c7b-a8ae-31cf3b3dc5ec tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:32:56.471901 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-ccfb75f1-5707-4c7b-a8ae-31cf3b3dc5ec tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67" status: 200 len: 1266 microversion: 2.1 time: 0.149024 Nov 20 03:32:56.472464 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 598/1125] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:32:56 2021] GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:32:57.488549 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-3923a4b3-44db-494b-9e91-886059235b3b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:57.489153 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-3923a4b3-44db-494b-9e91-886059235b3b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: dd695701-5d21-42e3-b21d-2e6069ea2c67] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:57.495831 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3923a4b3-44db-494b-9e91-886059235b3b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:57.496477 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3923a4b3-44db-494b-9e91-886059235b3b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:57.497241 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3923a4b3-44db-494b-9e91-886059235b3b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:57.497671 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3923a4b3-44db-494b-9e91-886059235b3b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:57.628162 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-3923a4b3-44db-494b-9e91-886059235b3b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:32:57.636745 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-3923a4b3-44db-494b-9e91-886059235b3b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67" status: 200 len: 1266 microversion: 2.1 time: 0.151725 Nov 20 03:32:57.637325 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 528/1126] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:32:57 2021] GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:32:58.653448 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-7ed6eb2e-a271-46e2-b5da-e6ce7ba62e13 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:58.654049 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-7ed6eb2e-a271-46e2-b5da-e6ce7ba62e13 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: dd695701-5d21-42e3-b21d-2e6069ea2c67] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:58.660308 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7ed6eb2e-a271-46e2-b5da-e6ce7ba62e13 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:58.660756 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7ed6eb2e-a271-46e2-b5da-e6ce7ba62e13 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:58.661538 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7ed6eb2e-a271-46e2-b5da-e6ce7ba62e13 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:58.662457 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7ed6eb2e-a271-46e2-b5da-e6ce7ba62e13 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:58.805723 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-7ed6eb2e-a271-46e2-b5da-e6ce7ba62e13 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:32:58.812989 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-7ed6eb2e-a271-46e2-b5da-e6ce7ba62e13 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67" status: 200 len: 1266 microversion: 2.1 time: 0.163214 Nov 20 03:32:58.813560 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 599/1127] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:32:58 2021] GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:32:59.641404 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-10e1b331-7f18-4c6e-8c0e-f4b918f93bd6 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:32:59.648190 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-10e1b331-7f18-4c6e-8c0e-f4b918f93bd6 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:59.648647 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-10e1b331-7f18-4c6e-8c0e-f4b918f93bd6 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:59.714946 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-10e1b331-7f18-4c6e-8c0e-f4b918f93bd6 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Going to try to stop instance {{(pid=116114) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 20 03:32:59.829774 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-de6c1cea-d2a3-4bfb-aa23-a626ca90c7da tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:59.830330 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-de6c1cea-d2a3-4bfb-aa23-a626ca90c7da tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: dd695701-5d21-42e3-b21d-2e6069ea2c67] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:59.837473 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-de6c1cea-d2a3-4bfb-aa23-a626ca90c7da tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:59.837944 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-de6c1cea-d2a3-4bfb-aa23-a626ca90c7da tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:59.838739 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-de6c1cea-d2a3-4bfb-aa23-a626ca90c7da tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:59.839168 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-de6c1cea-d2a3-4bfb-aa23-a626ca90c7da tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:59.907656 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-10e1b331-7f18-4c6e-8c0e-f4b918f93bd6 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 202 len: 0 microversion: 2.1 time: 0.269760 Nov 20 03:32:59.908220 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 529/1128] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:32:59 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:32:59.917402 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-ea7a33c4-2b10-4e13-9583-0bc8f4f9bbc7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:32:59.918086 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-ea7a33c4-2b10-4e13-9583-0bc8f4f9bbc7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:32:59.924320 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ea7a33c4-2b10-4e13-9583-0bc8f4f9bbc7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:59.924774 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ea7a33c4-2b10-4e13-9583-0bc8f4f9bbc7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:32:59.925557 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ea7a33c4-2b10-4e13-9583-0bc8f4f9bbc7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:32:59.925984 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-ea7a33c4-2b10-4e13-9583-0bc8f4f9bbc7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:00.004121 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-de6c1cea-d2a3-4bfb-aa23-a626ca90c7da tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:00.012085 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-de6c1cea-d2a3-4bfb-aa23-a626ca90c7da tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67" status: 200 len: 1266 microversion: 2.1 time: 0.185992 Nov 20 03:33:00.012650 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 600/1129] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:32:59 2021] GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:33:00.073370 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-ea7a33c4-2b10-4e13-9583-0bc8f4f9bbc7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:00.081084 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-ea7a33c4-2b10-4e13-9583-0bc8f4f9bbc7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1725 microversion: 2.1 time: 0.168427 Nov 20 03:33:00.081600 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 530/1130] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:32:59 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:33:01.028694 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-07d8f5e3-ea2e-445e-8960-d3158a61b7aa tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:01.029346 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-07d8f5e3-ea2e-445e-8960-d3158a61b7aa tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: dd695701-5d21-42e3-b21d-2e6069ea2c67] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:01.035612 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-07d8f5e3-ea2e-445e-8960-d3158a61b7aa tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:01.036096 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-07d8f5e3-ea2e-445e-8960-d3158a61b7aa tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:01.037483 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-07d8f5e3-ea2e-445e-8960-d3158a61b7aa tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:01.037919 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-07d8f5e3-ea2e-445e-8960-d3158a61b7aa tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:01.098540 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-bebf15d8-9518-46ad-a453-d88f45522564 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:01.099904 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-bebf15d8-9518-46ad-a453-d88f45522564 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:01.106305 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bebf15d8-9518-46ad-a453-d88f45522564 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:01.106755 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bebf15d8-9518-46ad-a453-d88f45522564 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:01.107535 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bebf15d8-9518-46ad-a453-d88f45522564 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:01.108011 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bebf15d8-9518-46ad-a453-d88f45522564 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:01.191077 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-07d8f5e3-ea2e-445e-8960-d3158a61b7aa tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:01.198305 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-07d8f5e3-ea2e-445e-8960-d3158a61b7aa tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67" status: 200 len: 1266 microversion: 2.1 time: 0.173257 Nov 20 03:33:01.198873 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 601/1131] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:01 2021] GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:33:01.258305 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-bebf15d8-9518-46ad-a453-d88f45522564 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:01.266173 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-bebf15d8-9518-46ad-a453-d88f45522564 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1725 microversion: 2.1 time: 0.171623 Nov 20 03:33:01.266729 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 531/1132] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:01 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:33:02.214857 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-c3aa57d3-7d60-4312-b28c-3ea9a01ea617 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:02.215396 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-c3aa57d3-7d60-4312-b28c-3ea9a01ea617 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: dd695701-5d21-42e3-b21d-2e6069ea2c67] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:02.221984 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c3aa57d3-7d60-4312-b28c-3ea9a01ea617 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:02.222439 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c3aa57d3-7d60-4312-b28c-3ea9a01ea617 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:02.223237 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c3aa57d3-7d60-4312-b28c-3ea9a01ea617 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:02.223676 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c3aa57d3-7d60-4312-b28c-3ea9a01ea617 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:02.284025 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-70c1e359-a091-459e-bcb9-f991a1f59c60 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:02.284646 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-70c1e359-a091-459e-bcb9-f991a1f59c60 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:02.293035 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-70c1e359-a091-459e-bcb9-f991a1f59c60 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:02.293499 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-70c1e359-a091-459e-bcb9-f991a1f59c60 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:02.294293 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-70c1e359-a091-459e-bcb9-f991a1f59c60 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:02.294732 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-70c1e359-a091-459e-bcb9-f991a1f59c60 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:02.380558 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-c3aa57d3-7d60-4312-b28c-3ea9a01ea617 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:02.387744 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-c3aa57d3-7d60-4312-b28c-3ea9a01ea617 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67" status: 200 len: 1266 microversion: 2.1 time: 0.176612 Nov 20 03:33:02.388360 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 602/1133] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:02 2021] GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:33:02.442160 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-70c1e359-a091-459e-bcb9-f991a1f59c60 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:02.449871 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-70c1e359-a091-459e-bcb9-f991a1f59c60 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1725 microversion: 2.1 time: 0.169615 Nov 20 03:33:02.450432 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 532/1134] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:02 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:33:03.404508 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-b6052323-b846-4960-8904-61268098cbd3 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:03.405137 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-b6052323-b846-4960-8904-61268098cbd3 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: dd695701-5d21-42e3-b21d-2e6069ea2c67] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:03.411568 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b6052323-b846-4960-8904-61268098cbd3 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:03.412083 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b6052323-b846-4960-8904-61268098cbd3 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:03.412935 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b6052323-b846-4960-8904-61268098cbd3 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:03.413375 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b6052323-b846-4960-8904-61268098cbd3 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:03.467230 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-15f18abf-b2a0-4835-b091-285fc1cb8b5d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:03.467928 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-15f18abf-b2a0-4835-b091-285fc1cb8b5d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:03.475651 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-15f18abf-b2a0-4835-b091-285fc1cb8b5d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:03.476126 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-15f18abf-b2a0-4835-b091-285fc1cb8b5d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:03.477167 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-15f18abf-b2a0-4835-b091-285fc1cb8b5d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:03.477590 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-15f18abf-b2a0-4835-b091-285fc1cb8b5d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:03.587096 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-b6052323-b846-4960-8904-61268098cbd3 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:03.595599 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-b6052323-b846-4960-8904-61268098cbd3 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67" status: 200 len: 1266 microversion: 2.1 time: 0.194829 Nov 20 03:33:03.596211 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 603/1135] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:03 2021] GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:33:03.602487 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-d89fdadc-7103-4e9d-ac8b-836cfa610e74 req-54f8e5b2-9bec-4b7f-ab42-2e010d04cdfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd695701-5d21-42e3-b21d-2e6069ea2c67", "name": "network-vif-plugged", "status": "completed", "tag": "b1b6c435-4da9-495a-9684-c863636515b2"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:33:03.604346 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:33:03.604346 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:33:03.616246 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-d89fdadc-7103-4e9d-ac8b-836cfa610e74 req-54f8e5b2-9bec-4b7f-ab42-2e010d04cdfe service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:03.616762 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-d89fdadc-7103-4e9d-ac8b-836cfa610e74 req-54f8e5b2-9bec-4b7f-ab42-2e010d04cdfe service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:03.627823 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-d89fdadc-7103-4e9d-ac8b-836cfa610e74 req-54f8e5b2-9bec-4b7f-ab42-2e010d04cdfe service nova] Creating event network-vif-plugged:b1b6c435-4da9-495a-9684-c863636515b2 for instance dd695701-5d21-42e3-b21d-2e6069ea2c67 on hv-cinder-81803 Nov 20 03:33:03.633187 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-d89fdadc-7103-4e9d-ac8b-836cfa610e74 req-54f8e5b2-9bec-4b7f-ab42-2e010d04cdfe service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035541 Nov 20 03:33:03.634542 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 604/1136] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:33:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:33:03.657160 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-15f18abf-b2a0-4835-b091-285fc1cb8b5d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:03.665580 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-15f18abf-b2a0-4835-b091-285fc1cb8b5d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1725 microversion: 2.1 time: 0.202029 Nov 20 03:33:03.675249 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 533/1137] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:03 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:33:04.614145 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-71101ce4-7f05-495c-9c5e-ab8b4773a0fc tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:04.614802 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-71101ce4-7f05-495c-9c5e-ab8b4773a0fc tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: dd695701-5d21-42e3-b21d-2e6069ea2c67] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:04.620946 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-71101ce4-7f05-495c-9c5e-ab8b4773a0fc tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:04.621403 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-71101ce4-7f05-495c-9c5e-ab8b4773a0fc tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:04.622179 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-71101ce4-7f05-495c-9c5e-ab8b4773a0fc tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:04.622618 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-71101ce4-7f05-495c-9c5e-ab8b4773a0fc tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:04.682651 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-fdf6b84a-2d8b-4279-918b-f7f9d1209a33 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:04.683264 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-fdf6b84a-2d8b-4279-918b-f7f9d1209a33 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:04.689484 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fdf6b84a-2d8b-4279-918b-f7f9d1209a33 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:04.689941 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fdf6b84a-2d8b-4279-918b-f7f9d1209a33 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:04.690723 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fdf6b84a-2d8b-4279-918b-f7f9d1209a33 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:04.691162 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fdf6b84a-2d8b-4279-918b-f7f9d1209a33 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:04.782069 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-71101ce4-7f05-495c-9c5e-ab8b4773a0fc tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:04.789574 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-71101ce4-7f05-495c-9c5e-ab8b4773a0fc tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67" status: 200 len: 1266 microversion: 2.1 time: 0.179974 Nov 20 03:33:04.790143 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 605/1138] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:04 2021] GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:33:04.849132 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-fdf6b84a-2d8b-4279-918b-f7f9d1209a33 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:04.856936 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-fdf6b84a-2d8b-4279-918b-f7f9d1209a33 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1725 microversion: 2.1 time: 0.177954 Nov 20 03:33:04.857505 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 534/1139] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:04 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:33:05.806292 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-81f19ff0-ecc3-45a5-9fdb-08036201a94a tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:05.806899 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-81f19ff0-ecc3-45a5-9fdb-08036201a94a tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: dd695701-5d21-42e3-b21d-2e6069ea2c67] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:05.813132 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-81f19ff0-ecc3-45a5-9fdb-08036201a94a tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:05.813575 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-81f19ff0-ecc3-45a5-9fdb-08036201a94a tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:05.814343 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-81f19ff0-ecc3-45a5-9fdb-08036201a94a tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:05.814773 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-81f19ff0-ecc3-45a5-9fdb-08036201a94a tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:05.874915 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-351de2ac-3119-49b5-a1e1-b7776b1ccc33 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:05.875528 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-351de2ac-3119-49b5-a1e1-b7776b1ccc33 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:05.882276 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-351de2ac-3119-49b5-a1e1-b7776b1ccc33 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:05.882724 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-351de2ac-3119-49b5-a1e1-b7776b1ccc33 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:05.883513 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-351de2ac-3119-49b5-a1e1-b7776b1ccc33 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:05.883978 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-351de2ac-3119-49b5-a1e1-b7776b1ccc33 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:05.972821 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-81f19ff0-ecc3-45a5-9fdb-08036201a94a tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:05.980282 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-81f19ff0-ecc3-45a5-9fdb-08036201a94a tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67" status: 200 len: 1454 microversion: 2.1 time: 0.177822 Nov 20 03:33:05.980847 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 606/1140] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:05 2021] GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67 => generated 1454 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:33:05.995629 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-373008c7-6fd2-41fa-96bc-70466f4a182c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:05.996294 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-373008c7-6fd2-41fa-96bc-70466f4a182c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: dd695701-5d21-42e3-b21d-2e6069ea2c67] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:06.002169 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-373008c7-6fd2-41fa-96bc-70466f4a182c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:06.002615 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-373008c7-6fd2-41fa-96bc-70466f4a182c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:06.003389 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-373008c7-6fd2-41fa-96bc-70466f4a182c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:06.003841 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-373008c7-6fd2-41fa-96bc-70466f4a182c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:06.037642 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-351de2ac-3119-49b5-a1e1-b7776b1ccc33 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:06.045586 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-351de2ac-3119-49b5-a1e1-b7776b1ccc33 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1725 microversion: 2.1 time: 0.174379 Nov 20 03:33:06.046353 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 535/1141] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:05 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:33:06.137025 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-373008c7-6fd2-41fa-96bc-70466f4a182c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:06.144200 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-373008c7-6fd2-41fa-96bc-70466f4a182c tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67" status: 200 len: 1454 microversion: 2.1 time: 0.151959 Nov 20 03:33:06.144764 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 607/1142] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:05 2021] GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:33:07.062397 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-d2595fd9-57bd-444a-b8b2-6a4c5ecef405 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:07.062946 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-d2595fd9-57bd-444a-b8b2-6a4c5ecef405 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:07.069237 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d2595fd9-57bd-444a-b8b2-6a4c5ecef405 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:07.069677 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d2595fd9-57bd-444a-b8b2-6a4c5ecef405 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:07.070449 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d2595fd9-57bd-444a-b8b2-6a4c5ecef405 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:07.070879 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d2595fd9-57bd-444a-b8b2-6a4c5ecef405 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:07.291743 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-d2595fd9-57bd-444a-b8b2-6a4c5ecef405 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:07.299998 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-d2595fd9-57bd-444a-b8b2-6a4c5ecef405 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1725 microversion: 2.1 time: 0.241245 Nov 20 03:33:07.300582 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 536/1143] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:07 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1725 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:33:08.215385 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-0b5ff060-f720-41cc-93e6-5f6746a46678 req-18eb9677-469e-4fa5-a8d3-9ba78243a7d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd695701-5d21-42e3-b21d-2e6069ea2c67", "tag": "b1b6c435-4da9-495a-9684-c863636515b2"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:33:08.219949 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:33:08.219949 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:33:08.227351 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-0b5ff060-f720-41cc-93e6-5f6746a46678 req-18eb9677-469e-4fa5-a8d3-9ba78243a7d0 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:08.227813 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-0b5ff060-f720-41cc-93e6-5f6746a46678 req-18eb9677-469e-4fa5-a8d3-9ba78243a7d0 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:08.239001 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-0b5ff060-f720-41cc-93e6-5f6746a46678 req-18eb9677-469e-4fa5-a8d3-9ba78243a7d0 service nova] Creating event network-changed:b1b6c435-4da9-495a-9684-c863636515b2 for instance dd695701-5d21-42e3-b21d-2e6069ea2c67 on hv-cinder-81803 Nov 20 03:33:08.244501 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-0b5ff060-f720-41cc-93e6-5f6746a46678 req-18eb9677-469e-4fa5-a8d3-9ba78243a7d0 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032683 Nov 20 03:33:08.245274 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 608/1144] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:33:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:33:08.317170 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-27f093df-2ebc-41f4-bfd3-49ce1a177ea5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:08.317819 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-27f093df-2ebc-41f4-bfd3-49ce1a177ea5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:08.324423 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-27f093df-2ebc-41f4-bfd3-49ce1a177ea5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:08.325153 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-27f093df-2ebc-41f4-bfd3-49ce1a177ea5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:08.325950 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-27f093df-2ebc-41f4-bfd3-49ce1a177ea5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:08.326389 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-27f093df-2ebc-41f4-bfd3-49ce1a177ea5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:08.557421 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-27f093df-2ebc-41f4-bfd3-49ce1a177ea5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:08.565334 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-27f093df-2ebc-41f4-bfd3-49ce1a177ea5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1725 microversion: 2.1 time: 0.251788 Nov 20 03:33:08.565902 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 537/1145] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:08 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1725 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:33:09.583127 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-8b99c6af-ae76-436e-a856-23a57228845b tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:09.583873 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-8b99c6af-ae76-436e-a856-23a57228845b tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:09.590266 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8b99c6af-ae76-436e-a856-23a57228845b tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:09.590851 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8b99c6af-ae76-436e-a856-23a57228845b tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:09.591651 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8b99c6af-ae76-436e-a856-23a57228845b tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:09.592126 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8b99c6af-ae76-436e-a856-23a57228845b tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:09.731193 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-8b99c6af-ae76-436e-a856-23a57228845b tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:09.738958 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-8b99c6af-ae76-436e-a856-23a57228845b tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1725 microversion: 2.1 time: 0.160271 Nov 20 03:33:09.740180 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 609/1146] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:09 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:33:10.756512 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-5f492795-5541-487a-a19b-e30e474da74f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:10.757130 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-5f492795-5541-487a-a19b-e30e474da74f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:10.763473 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5f492795-5541-487a-a19b-e30e474da74f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:10.763961 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5f492795-5541-487a-a19b-e30e474da74f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:10.764742 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5f492795-5541-487a-a19b-e30e474da74f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:10.765180 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5f492795-5541-487a-a19b-e30e474da74f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:10.897642 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-5f492795-5541-487a-a19b-e30e474da74f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:10.905573 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-5f492795-5541-487a-a19b-e30e474da74f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1725 microversion: 2.1 time: 0.152728 Nov 20 03:33:10.906134 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 538/1147] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:10 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:33:11.923409 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-2b2096f7-3b4c-45c2-9a3a-d8d396a7a99c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:11.924072 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-2b2096f7-3b4c-45c2-9a3a-d8d396a7a99c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:11.931079 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2b2096f7-3b4c-45c2-9a3a-d8d396a7a99c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:11.931529 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2b2096f7-3b4c-45c2-9a3a-d8d396a7a99c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:11.932363 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2b2096f7-3b4c-45c2-9a3a-d8d396a7a99c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:11.932825 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2b2096f7-3b4c-45c2-9a3a-d8d396a7a99c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:12.060445 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-2b2096f7-3b4c-45c2-9a3a-d8d396a7a99c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:12.068160 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-2b2096f7-3b4c-45c2-9a3a-d8d396a7a99c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1725 microversion: 2.1 time: 0.148336 Nov 20 03:33:12.068739 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 610/1148] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:11 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:33:13.085229 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-db71d6b6-62a2-4788-86b0-6bbc1ed95be1 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:13.085776 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-db71d6b6-62a2-4788-86b0-6bbc1ed95be1 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:13.092649 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-db71d6b6-62a2-4788-86b0-6bbc1ed95be1 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:13.093105 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-db71d6b6-62a2-4788-86b0-6bbc1ed95be1 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:13.093895 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-db71d6b6-62a2-4788-86b0-6bbc1ed95be1 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:13.094593 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-db71d6b6-62a2-4788-86b0-6bbc1ed95be1 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:13.224294 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-db71d6b6-62a2-4788-86b0-6bbc1ed95be1 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:13.232065 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-db71d6b6-62a2-4788-86b0-6bbc1ed95be1 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1725 microversion: 2.1 time: 0.150664 Nov 20 03:33:13.232628 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 539/1149] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:13 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:33:14.249737 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-4d70a78e-1468-4083-a63d-27f36d5e3bbc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:14.250360 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-4d70a78e-1468-4083-a63d-27f36d5e3bbc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:14.257340 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4d70a78e-1468-4083-a63d-27f36d5e3bbc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:14.257790 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4d70a78e-1468-4083-a63d-27f36d5e3bbc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:14.258579 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4d70a78e-1468-4083-a63d-27f36d5e3bbc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:14.259016 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4d70a78e-1468-4083-a63d-27f36d5e3bbc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:14.388124 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-4d70a78e-1468-4083-a63d-27f36d5e3bbc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:14.396373 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-4d70a78e-1468-4083-a63d-27f36d5e3bbc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1725 microversion: 2.1 time: 0.150271 Nov 20 03:33:14.396933 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 611/1150] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:14 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:33:15.412524 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-cc68d385-6599-491a-a899-ac2056190649 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:15.413106 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-cc68d385-6599-491a-a899-ac2056190649 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:15.418981 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cc68d385-6599-491a-a899-ac2056190649 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:15.419420 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cc68d385-6599-491a-a899-ac2056190649 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:15.420219 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cc68d385-6599-491a-a899-ac2056190649 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:15.420646 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cc68d385-6599-491a-a899-ac2056190649 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:15.550596 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-cc68d385-6599-491a-a899-ac2056190649 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:15.558738 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-cc68d385-6599-491a-a899-ac2056190649 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1702 microversion: 2.1 time: 0.149890 Nov 20 03:33:15.559279 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 540/1151] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:15 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1702 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:33:15.575322 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-c8499e5c-07b8-46eb-ae7e-edbe591949d1 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:33:15.581536 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c8499e5c-07b8-46eb-ae7e-edbe591949d1 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:15.581982 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c8499e5c-07b8-46eb-ae7e-edbe591949d1 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:15.642381 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-c8499e5c-07b8-46eb-ae7e-edbe591949d1 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Going to try to start instance {{(pid=116113) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 20 03:33:15.681035 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-c8499e5c-07b8-46eb-ae7e-edbe591949d1 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 202 len: 0 microversion: 2.1 time: 0.109195 Nov 20 03:33:15.681577 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 612/1152] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:33:15 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:33:15.689498 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-48eb1866-f972-4784-a353-17bd88b6c5f8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:15.690132 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-48eb1866-f972-4784-a353-17bd88b6c5f8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:15.695925 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-48eb1866-f972-4784-a353-17bd88b6c5f8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:15.697199 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-48eb1866-f972-4784-a353-17bd88b6c5f8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:15.698230 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-48eb1866-f972-4784-a353-17bd88b6c5f8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:15.698854 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-48eb1866-f972-4784-a353-17bd88b6c5f8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:15.854160 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-48eb1866-f972-4784-a353-17bd88b6c5f8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:15.861899 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-48eb1866-f972-4784-a353-17bd88b6c5f8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1711 microversion: 2.1 time: 0.176102 Nov 20 03:33:15.862462 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 541/1153] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:15 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1711 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:33:16.881076 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-9bf12aa2-627a-49de-ad71-222180d6d01d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:16.881808 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-9bf12aa2-627a-49de-ad71-222180d6d01d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:16.887928 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9bf12aa2-627a-49de-ad71-222180d6d01d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:16.888384 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9bf12aa2-627a-49de-ad71-222180d6d01d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:16.889170 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9bf12aa2-627a-49de-ad71-222180d6d01d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:16.889611 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-9bf12aa2-627a-49de-ad71-222180d6d01d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:17.022847 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-9bf12aa2-627a-49de-ad71-222180d6d01d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:17.030550 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-9bf12aa2-627a-49de-ad71-222180d6d01d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1711 microversion: 2.1 time: 0.153986 Nov 20 03:33:17.031103 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 613/1154] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:16 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1711 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:33:18.048262 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-307435e4-3b48-47ef-a0e3-c5ca028aa909 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:18.048878 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-307435e4-3b48-47ef-a0e3-c5ca028aa909 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:18.055962 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-307435e4-3b48-47ef-a0e3-c5ca028aa909 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:18.056416 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-307435e4-3b48-47ef-a0e3-c5ca028aa909 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:18.057200 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-307435e4-3b48-47ef-a0e3-c5ca028aa909 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:18.057635 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-307435e4-3b48-47ef-a0e3-c5ca028aa909 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:18.187331 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-307435e4-3b48-47ef-a0e3-c5ca028aa909 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:18.195077 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-307435e4-3b48-47ef-a0e3-c5ca028aa909 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1715 microversion: 2.1 time: 0.150476 Nov 20 03:33:18.195646 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 542/1155] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:18 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1715 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:33:51.423302 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-0972b8d4-d554-4ecf-bf51-78d54d5121c7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:51.423913 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-0972b8d4-d554-4ecf-bf51-78d54d5121c7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:51.429869 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0972b8d4-d554-4ecf-bf51-78d54d5121c7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:51.430323 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0972b8d4-d554-4ecf-bf51-78d54d5121c7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:51.431102 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0972b8d4-d554-4ecf-bf51-78d54d5121c7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:51.431541 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0972b8d4-d554-4ecf-bf51-78d54d5121c7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:51.506625 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.objects.instance [None req-0972b8d4-d554-4ecf-bf51-78d54d5121c7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lazy-loading 'services' on Instance uuid e2109e70-6d36-409e-a430-4e36ba685082 {{(pid=116113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 03:33:51.573067 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-0972b8d4-d554-4ecf-bf51-78d54d5121c7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "DELETE /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/os-volume_attachments/fdfb191c-46af-4bd1-a958-5255a76373db" status: 202 len: 0 microversion: 2.1 time: 0.153372 Nov 20 03:33:51.573648 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 614/1156] 10.222.0.37 () {58 vars in 1415 bytes} [Sat Nov 20 03:33:51 2021] DELETE /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/os-volume_attachments/fdfb191c-46af-4bd1-a958-5255a76373db => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:33:52.677430 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-fab3f368-0ada-4579-a4cb-4fa4669dd1b3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:33:52.683382 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fab3f368-0ada-4579-a4cb-4fa4669dd1b3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:52.683861 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-fab3f368-0ada-4579-a4cb-4fa4669dd1b3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:52.706950 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-fab3f368-0ada-4579-a4cb-4fa4669dd1b3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Going to try to stop instance {{(pid=116114) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 20 03:33:52.746234 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-fab3f368-0ada-4579-a4cb-4fa4669dd1b3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 202 len: 0 microversion: 2.1 time: 0.072941 Nov 20 03:33:52.746821 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 543/1157] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:33:52 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:33:52.756507 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-46ec399f-c559-4f5d-8cd8-5395f91e2fef tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:52.757208 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-46ec399f-c559-4f5d-8cd8-5395f91e2fef tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:52.763246 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-46ec399f-c559-4f5d-8cd8-5395f91e2fef tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:52.763705 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-46ec399f-c559-4f5d-8cd8-5395f91e2fef tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:52.764673 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-46ec399f-c559-4f5d-8cd8-5395f91e2fef tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:52.765119 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-46ec399f-c559-4f5d-8cd8-5395f91e2fef tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:52.894370 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-46ec399f-c559-4f5d-8cd8-5395f91e2fef tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:52.901961 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-46ec399f-c559-4f5d-8cd8-5395f91e2fef tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1679 microversion: 2.1 time: 0.150437 Nov 20 03:33:52.902313 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 615/1158] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:52 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:33:53.919592 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-20aa5512-98c1-461a-8d7d-da54d229b930 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:53.920359 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-20aa5512-98c1-461a-8d7d-da54d229b930 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:53.926423 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-20aa5512-98c1-461a-8d7d-da54d229b930 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:53.926876 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-20aa5512-98c1-461a-8d7d-da54d229b930 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:53.927659 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-20aa5512-98c1-461a-8d7d-da54d229b930 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:53.928138 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-20aa5512-98c1-461a-8d7d-da54d229b930 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:54.058536 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-20aa5512-98c1-461a-8d7d-da54d229b930 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:54.066337 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-20aa5512-98c1-461a-8d7d-da54d229b930 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1679 microversion: 2.1 time: 0.151127 Nov 20 03:33:54.066985 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 544/1159] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:53 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:33:55.083199 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-bec568a2-a7cc-4a52-be9d-2c4d21b0e5aa tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:55.083879 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-bec568a2-a7cc-4a52-be9d-2c4d21b0e5aa tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:55.090171 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bec568a2-a7cc-4a52-be9d-2c4d21b0e5aa tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:55.090629 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bec568a2-a7cc-4a52-be9d-2c4d21b0e5aa tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:55.091408 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bec568a2-a7cc-4a52-be9d-2c4d21b0e5aa tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:55.091873 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bec568a2-a7cc-4a52-be9d-2c4d21b0e5aa tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:55.221390 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-bec568a2-a7cc-4a52-be9d-2c4d21b0e5aa tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:55.229213 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-bec568a2-a7cc-4a52-be9d-2c4d21b0e5aa tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1679 microversion: 2.1 time: 0.150202 Nov 20 03:33:55.229766 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 616/1160] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:55 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:33:56.246062 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-72af85d6-c225-4786-b1ed-39bc27db69bc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:56.246603 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-72af85d6-c225-4786-b1ed-39bc27db69bc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:56.252959 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-72af85d6-c225-4786-b1ed-39bc27db69bc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:56.253403 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-72af85d6-c225-4786-b1ed-39bc27db69bc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:56.254164 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-72af85d6-c225-4786-b1ed-39bc27db69bc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:56.254592 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-72af85d6-c225-4786-b1ed-39bc27db69bc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:56.381927 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-72af85d6-c225-4786-b1ed-39bc27db69bc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:56.389202 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-72af85d6-c225-4786-b1ed-39bc27db69bc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1679 microversion: 2.1 time: 0.146896 Nov 20 03:33:56.389770 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 545/1161] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:56 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:33:57.406268 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-77c2c3d8-b7bd-4334-a298-f43917485a88 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:57.406881 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-77c2c3d8-b7bd-4334-a298-f43917485a88 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:57.413638 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-77c2c3d8-b7bd-4334-a298-f43917485a88 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:57.414084 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-77c2c3d8-b7bd-4334-a298-f43917485a88 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:57.414845 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-77c2c3d8-b7bd-4334-a298-f43917485a88 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:57.415276 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-77c2c3d8-b7bd-4334-a298-f43917485a88 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:57.546058 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-77c2c3d8-b7bd-4334-a298-f43917485a88 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:57.553285 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-77c2c3d8-b7bd-4334-a298-f43917485a88 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1679 microversion: 2.1 time: 0.150754 Nov 20 03:33:57.553849 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 617/1162] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:57 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:33:58.570601 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-08777c9d-e066-412b-ac14-75547a506edd tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:58.571177 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-08777c9d-e066-412b-ac14-75547a506edd tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:58.577521 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-08777c9d-e066-412b-ac14-75547a506edd tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:58.577979 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-08777c9d-e066-412b-ac14-75547a506edd tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:58.578754 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-08777c9d-e066-412b-ac14-75547a506edd tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:58.579196 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-08777c9d-e066-412b-ac14-75547a506edd tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:58.709096 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-08777c9d-e066-412b-ac14-75547a506edd tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:58.716405 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-08777c9d-e066-412b-ac14-75547a506edd tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1656 microversion: 2.1 time: 0.149724 Nov 20 03:33:58.716965 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 546/1163] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:58 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1656 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:33:58.733414 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-22cc9915-fd18-400a-a386-342fa3f518c3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:33:58.739633 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-22cc9915-fd18-400a-a386-342fa3f518c3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:58.740127 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-22cc9915-fd18-400a-a386-342fa3f518c3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:58.762854 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-22cc9915-fd18-400a-a386-342fa3f518c3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Going to try to start instance {{(pid=116113) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 20 03:33:58.803270 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-22cc9915-fd18-400a-a386-342fa3f518c3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action" status: 202 len: 0 microversion: 2.1 time: 0.073345 Nov 20 03:33:58.803875 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 618/1164] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:33:58 2021] POST /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:33:58.811680 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-9723480c-b49e-4246-9a2e-0eb9afbf9801 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:58.812337 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-9723480c-b49e-4246-9a2e-0eb9afbf9801 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:58.818344 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9723480c-b49e-4246-9a2e-0eb9afbf9801 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:58.818793 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9723480c-b49e-4246-9a2e-0eb9afbf9801 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:58.819898 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9723480c-b49e-4246-9a2e-0eb9afbf9801 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:58.820495 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9723480c-b49e-4246-9a2e-0eb9afbf9801 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:58.958108 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-9723480c-b49e-4246-9a2e-0eb9afbf9801 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:33:58.965924 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-9723480c-b49e-4246-9a2e-0eb9afbf9801 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1665 microversion: 2.1 time: 0.157787 Nov 20 03:33:58.966509 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 547/1165] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:58 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1665 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:33:59.984810 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-4992281a-cde8-4038-bbf7-a8a86c529dc3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:33:59.985544 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-4992281a-cde8-4038-bbf7-a8a86c529dc3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:33:59.993579 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4992281a-cde8-4038-bbf7-a8a86c529dc3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:59.994428 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4992281a-cde8-4038-bbf7-a8a86c529dc3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:33:59.995485 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4992281a-cde8-4038-bbf7-a8a86c529dc3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:33:59.996227 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4992281a-cde8-4038-bbf7-a8a86c529dc3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:00.130916 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-4992281a-cde8-4038-bbf7-a8a86c529dc3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:34:00.138367 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-4992281a-cde8-4038-bbf7-a8a86c529dc3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1665 microversion: 2.1 time: 0.157983 Nov 20 03:34:00.138934 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 619/1166] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:33:59 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1665 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:34:01.156209 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-eb8f5d79-e3b8-437b-a571-4051e5794dd7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:01.156732 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-eb8f5d79-e3b8-437b-a571-4051e5794dd7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:01.162981 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-eb8f5d79-e3b8-437b-a571-4051e5794dd7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:01.163435 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-eb8f5d79-e3b8-437b-a571-4051e5794dd7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:01.164243 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-eb8f5d79-e3b8-437b-a571-4051e5794dd7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:01.164687 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-eb8f5d79-e3b8-437b-a571-4051e5794dd7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:01.293838 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-eb8f5d79-e3b8-437b-a571-4051e5794dd7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:34:01.301818 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-eb8f5d79-e3b8-437b-a571-4051e5794dd7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1669 microversion: 2.1 time: 0.149326 Nov 20 03:34:01.302389 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 548/1167] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:34:01 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1669 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:34:33.436551 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-7624c8a8-ed44-4ca1-b756-884c831e0f49 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:33.437515 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-7624c8a8-ed44-4ca1-b756-884c831e0f49 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:33.444808 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7624c8a8-ed44-4ca1-b756-884c831e0f49 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:33.445261 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7624c8a8-ed44-4ca1-b756-884c831e0f49 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:33.446037 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7624c8a8-ed44-4ca1-b756-884c831e0f49 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:33.446468 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7624c8a8-ed44-4ca1-b756-884c831e0f49 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:33.474980 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-7624c8a8-ed44-4ca1-b756-884c831e0f49 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042201 Nov 20 03:34:33.475633 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 620/1168] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:34:33 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 03:34:33.529026 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-49255933-8b07-497d-a266-833b0ee8affe tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:33.529531 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-49255933-8b07-497d-a266-833b0ee8affe tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:33.536075 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-49255933-8b07-497d-a266-833b0ee8affe tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:33.536526 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-49255933-8b07-497d-a266-833b0ee8affe tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:33.537301 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-49255933-8b07-497d-a266-833b0ee8affe tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:33.537735 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-49255933-8b07-497d-a266-833b0ee8affe tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:33.561645 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-49255933-8b07-497d-a266-833b0ee8affe tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Going to try to terminate instance {{(pid=116114) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 03:34:33.632320 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-49255933-8b07-497d-a266-833b0ee8affe tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "DELETE /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 204 len: 0 microversion: 2.1 time: 0.106483 Nov 20 03:34:33.632918 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 549/1169] 10.222.0.37 () {58 vars in 1238 bytes} [Sat Nov 20 03:34:33 2021] DELETE /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 03:34:33.641908 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-bca040b5-445d-4a20-90ef-1d68f451434f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:33.642459 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-bca040b5-445d-4a20-90ef-1d68f451434f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:33.648298 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bca040b5-445d-4a20-90ef-1d68f451434f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:33.648752 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bca040b5-445d-4a20-90ef-1d68f451434f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:33.649533 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bca040b5-445d-4a20-90ef-1d68f451434f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:33.649976 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-bca040b5-445d-4a20-90ef-1d68f451434f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:33.779185 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-bca040b5-445d-4a20-90ef-1d68f451434f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:34:33.787084 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-bca040b5-445d-4a20-90ef-1d68f451434f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1675 microversion: 2.1 time: 0.149645 Nov 20 03:34:33.787648 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 621/1170] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:34:33 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:34:34.804809 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-d681c632-315c-46dc-b2d1-6fc964b0f8bd tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:34.805507 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-d681c632-315c-46dc-b2d1-6fc964b0f8bd tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:34.811727 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d681c632-315c-46dc-b2d1-6fc964b0f8bd tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:34.812209 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d681c632-315c-46dc-b2d1-6fc964b0f8bd tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:34.812985 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d681c632-315c-46dc-b2d1-6fc964b0f8bd tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:34.813421 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d681c632-315c-46dc-b2d1-6fc964b0f8bd tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:35.046888 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-d681c632-315c-46dc-b2d1-6fc964b0f8bd tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:34:35.054233 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-d681c632-315c-46dc-b2d1-6fc964b0f8bd tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1675 microversion: 2.1 time: 0.253522 Nov 20 03:34:35.054797 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 550/1171] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:34:34 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1675 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:34:36.071237 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-cfa728dd-a90a-4a1b-94aa-c5481f246de7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:36.071877 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-cfa728dd-a90a-4a1b-94aa-c5481f246de7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:36.078180 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cfa728dd-a90a-4a1b-94aa-c5481f246de7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:36.078629 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cfa728dd-a90a-4a1b-94aa-c5481f246de7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:36.079412 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cfa728dd-a90a-4a1b-94aa-c5481f246de7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:36.079876 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cfa728dd-a90a-4a1b-94aa-c5481f246de7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:36.359129 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-cfa728dd-a90a-4a1b-94aa-c5481f246de7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:34:36.366759 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-cfa728dd-a90a-4a1b-94aa-c5481f246de7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 200 len: 1675 microversion: 2.1 time: 0.299137 Nov 20 03:34:36.367552 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 622/1172] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:34:36 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 1675 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:34:36.735184 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-182fe2e3-b6b0-481e-a845-ea13cefe51f2 req-9bf076ba-960c-482c-b2ad-127023f94edb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2109e70-6d36-409e-a430-4e36ba685082", "name": "network-vif-deleted", "tag": "7404f5fe-b108-47a0-b58a-57236ae12240"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:34:36.737631 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:34:36.737631 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:34:36.745824 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-182fe2e3-b6b0-481e-a845-ea13cefe51f2 req-9bf076ba-960c-482c-b2ad-127023f94edb service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:36.746267 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-182fe2e3-b6b0-481e-a845-ea13cefe51f2 req-9bf076ba-960c-482c-b2ad-127023f94edb service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:36.766820 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-182fe2e3-b6b0-481e-a845-ea13cefe51f2 req-9bf076ba-960c-482c-b2ad-127023f94edb service nova] Creating event network-vif-deleted:7404f5fe-b108-47a0-b58a-57236ae12240 for instance e2109e70-6d36-409e-a430-4e36ba685082 on hv-cinder-81803 Nov 20 03:34:36.775095 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-182fe2e3-b6b0-481e-a845-ea13cefe51f2 req-9bf076ba-960c-482c-b2ad-127023f94edb service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043490 Nov 20 03:34:36.782332 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 551/1173] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:34:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:34:37.385394 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-6ba0ea4f-2f01-40fc-8f53-d41ef53e03b5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:37.386117 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-6ba0ea4f-2f01-40fc-8f53-d41ef53e03b5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:37.392288 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6ba0ea4f-2f01-40fc-8f53-d41ef53e03b5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:37.392742 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6ba0ea4f-2f01-40fc-8f53-d41ef53e03b5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:37.393530 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6ba0ea4f-2f01-40fc-8f53-d41ef53e03b5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:37.394521 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6ba0ea4f-2f01-40fc-8f53-d41ef53e03b5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:37.407399 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.wsgi [None req-6ba0ea4f-2f01-40fc-8f53-d41ef53e03b5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] HTTP exception thrown: Instance e2109e70-6d36-409e-a430-4e36ba685082 could not be found. Nov 20 03:34:37.408021 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-6ba0ea4f-2f01-40fc-8f53-d41ef53e03b5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Returning 404 to user: Instance e2109e70-6d36-409e-a430-4e36ba685082 could not be found. {{(pid=116113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:34:37.408844 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-6ba0ea4f-2f01-40fc-8f53-d41ef53e03b5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 404 len: 111 microversion: 2.1 time: 0.027325 Nov 20 03:34:37.409381 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 623/1174] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:34:37 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:34:37.418198 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-7e35decf-2d7c-43e0-a0db-9c6abebc847c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '.version_select at 0x7f2dac8ad790>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:37.435139 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-7e35decf-2d7c-43e0-a0db-9c6abebc847c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-327968092" status: 202 len: 0 microversion: 2.1 time: 0.020838 Nov 20 03:34:37.436094 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 552/1175] 10.222.0.37 () {58 vars in 1217 bytes} [Sat Nov 20 03:34:37 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-327968092 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:34:38.313718 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-badc72d6-6f2e-4fa9-bd9c-99b9c91825b8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'create', calling method: .version_select at 0x7f2dad3a30d0>, body: {"keypair": {"name": "tempest-keypair-2137808715"}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:34:38.327758 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-badc72d6-6f2e-4fa9-bd9c-99b9c91825b8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Getting quotas for project d08399259f414676ab07f0c72210e61b. Resources: {'key_pairs'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:34:38.332165 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-badc72d6-6f2e-4fa9-bd9c-99b9c91825b8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Getting quotas for user bdcb25cdee1f450d8c29a1f2b0ea60a7 and project d08399259f414676ab07f0c72210e61b. Resources: {'key_pairs'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:34:38.556598 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-badc72d6-6f2e-4fa9-bd9c-99b9c91825b8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Getting quotas for project d08399259f414676ab07f0c72210e61b. Resources: {'key_pairs'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:34:38.560072 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.quota [None req-badc72d6-6f2e-4fa9-bd9c-99b9c91825b8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Getting quotas for user bdcb25cdee1f450d8c29a1f2b0ea60a7 and project d08399259f414676ab07f0c72210e61b. Resources: {'key_pairs'} {{(pid=116113) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:34:38.573082 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-badc72d6-6f2e-4fa9-bd9c-99b9c91825b8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.263131 Nov 20 03:34:38.573670 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 624/1176] 10.222.0.37 () {60 vars in 1157 bytes} [Sat Nov 20 03:34:38 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:34:40.063433 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-5216ea00-1087-4f40-9615-2539215b0e18 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-463735233", "imageRef": "e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "791637e4-063d-499c-bfca-afedfcc04bcf"}], "security_groups": [{"name": "tempest-securitygroup--839213876"}], "key_name": "tempest-keypair-2137808715", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:34:40.168310 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.network.neutron [None req-5216ea00-1087-4f40-9615-2539215b0e18 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] validate_networks() for [('791637e4-063d-499c-bfca-afedfcc04bcf', None, None, None, None, None)] {{(pid=116114) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 03:34:40.545438 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-5216ea00-1087-4f40-9615-2539215b0e18 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Flavor limits 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 03:34:40.545858 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-5216ea00-1087-4f40-9615-2539215b0e18 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Image limits 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 03:34:40.546320 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-5216ea00-1087-4f40-9615-2539215b0e18 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Flavor pref 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 03:34:40.546723 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-5216ea00-1087-4f40-9615-2539215b0e18 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Image pref 0:0:0 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 03:34:40.547245 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.virt.hardware [None req-5216ea00-1087-4f40-9615-2539215b0e18 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 03:34:40.555841 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5216ea00-1087-4f40-9615-2539215b0e18 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:40.556289 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5216ea00-1087-4f40-9615-2539215b0e18 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:40.557095 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5216ea00-1087-4f40-9615-2539215b0e18 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:40.557524 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-5216ea00-1087-4f40-9615-2539215b0e18 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:40.573919 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-5216ea00-1087-4f40-9615-2539215b0e18 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Getting quotas for project d08399259f414676ab07f0c72210e61b. Resources: {'ram', 'cores', 'instances'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 03:34:40.577743 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.quota [None req-5216ea00-1087-4f40-9615-2539215b0e18 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Getting quotas for user bdcb25cdee1f450d8c29a1f2b0ea60a7 and project d08399259f414676ab07f0c72210e61b. Resources: {'ram', 'cores', 'instances'} {{(pid=116114) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 03:34:40.589246 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-5216ea00-1087-4f40-9615-2539215b0e18 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Going to run 1 instances... {{(pid=116114) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 03:34:40.591853 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-5216ea00-1087-4f40-9615-2539215b0e18 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e393f4f3-04e1-45ad-88ed-99aa8cbcaaf0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 03:34:40.641193 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-5216ea00-1087-4f40-9615-2539215b0e18 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.582188 Nov 20 03:34:40.642073 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 553/1177] 10.222.0.37 () {60 vars in 1146 bytes} [Sat Nov 20 03:34:40 2021] POST /compute/v2.1/servers => generated 401 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 03:34:40.652186 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-5cb2be1c-85f7-40b6-a12e-fa04ed0e0d92 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:40.652801 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-5cb2be1c-85f7-40b6-a12e-fa04ed0e0d92 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:40.758136 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-5cb2be1c-85f7-40b6-a12e-fa04ed0e0d92 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:34:40.766307 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-5cb2be1c-85f7-40b6-a12e-fa04ed0e0d92 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8" status: 200 len: 1237 microversion: 2.1 time: 0.118280 Nov 20 03:34:40.767103 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 625/1178] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:34:40 2021] GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8 => generated 1237 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:34:41.783956 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-68da4611-17bd-45e8-a098-49e58b9e0630 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:41.784579 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-68da4611-17bd-45e8-a098-49e58b9e0630 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:41.792854 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-68da4611-17bd-45e8-a098-49e58b9e0630 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:41.793451 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-68da4611-17bd-45e8-a098-49e58b9e0630 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:41.794368 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-68da4611-17bd-45e8-a098-49e58b9e0630 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:41.794908 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-68da4611-17bd-45e8-a098-49e58b9e0630 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:41.877820 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-68da4611-17bd-45e8-a098-49e58b9e0630 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:34:41.885867 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-68da4611-17bd-45e8-a098-49e58b9e0630 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8" status: 200 len: 1295 microversion: 2.1 time: 0.105624 Nov 20 03:34:41.886631 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 554/1179] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:34:41 2021] GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8 => generated 1295 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:34:42.903704 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-edef0e0d-f5de-464b-993a-a77110799d3e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:42.904254 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-edef0e0d-f5de-464b-993a-a77110799d3e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:42.911526 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-edef0e0d-f5de-464b-993a-a77110799d3e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:42.911818 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-edef0e0d-f5de-464b-993a-a77110799d3e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:42.912609 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-edef0e0d-f5de-464b-993a-a77110799d3e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:42.913222 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-edef0e0d-f5de-464b-993a-a77110799d3e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:43.048317 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-febb3df6-2bfb-463f-bdf3-b837d1845540 req-b59e8f32-040b-4b98-b2bc-bdc934d59414 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c45ebf32-845d-4d80-9393-0e6d2c7737e8", "tag": "24b1806d-1729-41db-a62b-40fd0907daf4"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:34:43.050475 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:34:43.050475 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:34:43.057849 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-febb3df6-2bfb-463f-bdf3-b837d1845540 req-b59e8f32-040b-4b98-b2bc-bdc934d59414 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:43.058601 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-febb3df6-2bfb-463f-bdf3-b837d1845540 req-b59e8f32-040b-4b98-b2bc-bdc934d59414 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:43.071338 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-febb3df6-2bfb-463f-bdf3-b837d1845540 req-b59e8f32-040b-4b98-b2bc-bdc934d59414 service nova] Creating event network-changed:24b1806d-1729-41db-a62b-40fd0907daf4 for instance c45ebf32-845d-4d80-9393-0e6d2c7737e8 on hv-cinder-81803 Nov 20 03:34:43.077672 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-febb3df6-2bfb-463f-bdf3-b837d1845540 req-b59e8f32-040b-4b98-b2bc-bdc934d59414 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118315 Nov 20 03:34:43.078699 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 555/1180] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:34:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:34:43.162139 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-edef0e0d-f5de-464b-993a-a77110799d3e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:34:43.169324 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-edef0e0d-f5de-464b-993a-a77110799d3e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8" status: 200 len: 1362 microversion: 2.1 time: 0.269366 Nov 20 03:34:43.169881 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 626/1181] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:34:42 2021] GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8 => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:34:44.187685 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-94e1c57c-aeca-4172-a4c9-c8926946a8d7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:44.188323 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-94e1c57c-aeca-4172-a4c9-c8926946a8d7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:44.197494 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-94e1c57c-aeca-4172-a4c9-c8926946a8d7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:44.198155 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-94e1c57c-aeca-4172-a4c9-c8926946a8d7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:44.199306 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-94e1c57c-aeca-4172-a4c9-c8926946a8d7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:44.199750 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-94e1c57c-aeca-4172-a4c9-c8926946a8d7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:44.332017 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-94e1c57c-aeca-4172-a4c9-c8926946a8d7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:34:44.339182 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-94e1c57c-aeca-4172-a4c9-c8926946a8d7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8" status: 200 len: 1362 microversion: 2.1 time: 0.156037 Nov 20 03:34:44.339737 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 556/1182] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:34:44 2021] GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:34:45.356093 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-1feae2ca-2cb2-498d-b7bd-63ded7047146 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:45.356632 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-1feae2ca-2cb2-498d-b7bd-63ded7047146 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:45.363484 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1feae2ca-2cb2-498d-b7bd-63ded7047146 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:45.363971 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1feae2ca-2cb2-498d-b7bd-63ded7047146 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:45.364753 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1feae2ca-2cb2-498d-b7bd-63ded7047146 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:45.365193 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-1feae2ca-2cb2-498d-b7bd-63ded7047146 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:45.494116 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-1feae2ca-2cb2-498d-b7bd-63ded7047146 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:34:45.501256 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-1feae2ca-2cb2-498d-b7bd-63ded7047146 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8" status: 200 len: 1362 microversion: 2.1 time: 0.148897 Nov 20 03:34:45.501812 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 627/1183] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:34:45 2021] GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:34:46.521287 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-4f314505-9d9f-44fb-8774-2ae64bd127ba tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:46.521823 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-4f314505-9d9f-44fb-8774-2ae64bd127ba tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:46.528199 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4f314505-9d9f-44fb-8774-2ae64bd127ba tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:46.528654 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4f314505-9d9f-44fb-8774-2ae64bd127ba tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:46.529434 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4f314505-9d9f-44fb-8774-2ae64bd127ba tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:46.529873 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4f314505-9d9f-44fb-8774-2ae64bd127ba tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:46.663153 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-4f314505-9d9f-44fb-8774-2ae64bd127ba tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:34:46.670600 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-4f314505-9d9f-44fb-8774-2ae64bd127ba tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8" status: 200 len: 1362 microversion: 2.1 time: 0.154835 Nov 20 03:34:46.671330 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 557/1184] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:34:46 2021] GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:34:47.691730 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-01884f0b-1e58-4c6b-9a76-86fac8807bd4 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:47.692368 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-01884f0b-1e58-4c6b-9a76-86fac8807bd4 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: dd695701-5d21-42e3-b21d-2e6069ea2c67] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:47.694749 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-8600a3a8-ebad-470f-97f7-94f45e378fad tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:47.695365 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-8600a3a8-ebad-470f-97f7-94f45e378fad tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:47.704619 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-01884f0b-1e58-4c6b-9a76-86fac8807bd4 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:47.705047 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8600a3a8-ebad-470f-97f7-94f45e378fad tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:47.705167 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-01884f0b-1e58-4c6b-9a76-86fac8807bd4 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:47.705595 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8600a3a8-ebad-470f-97f7-94f45e378fad tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:47.706341 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-01884f0b-1e58-4c6b-9a76-86fac8807bd4 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:47.706777 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-01884f0b-1e58-4c6b-9a76-86fac8807bd4 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:47.707163 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8600a3a8-ebad-470f-97f7-94f45e378fad tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:47.707710 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8600a3a8-ebad-470f-97f7-94f45e378fad tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:47.733805 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-01884f0b-1e58-4c6b-9a76-86fac8807bd4 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: dd695701-5d21-42e3-b21d-2e6069ea2c67] Going to try to terminate instance {{(pid=116114) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 03:34:47.825843 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-01884f0b-1e58-4c6b-9a76-86fac8807bd4 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "DELETE /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67" status: 204 len: 0 microversion: 2.1 time: 0.137745 Nov 20 03:34:47.826345 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 558/1185] 10.222.0.37 () {58 vars in 1238 bytes} [Sat Nov 20 03:34:47 2021] DELETE /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 20 03:34:47.834172 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-2d54771f-5b6f-4bb4-a625-2c8938d91e0f req-2014fccb-d323-48e2-93ab-b6cd0fb06e06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd695701-5d21-42e3-b21d-2e6069ea2c67", "tag": "b1b6c435-4da9-495a-9684-c863636515b2"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:34:47.835197 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:34:47.835197 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:34:47.842006 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-2d54771f-5b6f-4bb4-a625-2c8938d91e0f req-2014fccb-d323-48e2-93ab-b6cd0fb06e06 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:47.842455 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-2d54771f-5b6f-4bb4-a625-2c8938d91e0f req-2014fccb-d323-48e2-93ab-b6cd0fb06e06 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:47.853083 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-8600a3a8-ebad-470f-97f7-94f45e378fad tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:34:47.853940 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-2d54771f-5b6f-4bb4-a625-2c8938d91e0f req-2014fccb-d323-48e2-93ab-b6cd0fb06e06 service nova] Creating event network-changed:b1b6c435-4da9-495a-9684-c863636515b2 for instance dd695701-5d21-42e3-b21d-2e6069ea2c67 on hv-cinder-81803 Nov 20 03:34:47.858810 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-2d54771f-5b6f-4bb4-a625-2c8938d91e0f req-2014fccb-d323-48e2-93ab-b6cd0fb06e06 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031209 Nov 20 03:34:47.859566 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 559/1186] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:34:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:34:47.860629 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-8600a3a8-ebad-470f-97f7-94f45e378fad tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8" status: 200 len: 1362 microversion: 2.1 time: 0.176451 Nov 20 03:34:47.861485 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 628/1187] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:34:47 2021] GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:34:47.864385 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-470fe274-4373-4f9e-a09f-2874761aaea1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:47.865078 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-470fe274-4373-4f9e-a09f-2874761aaea1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: dd695701-5d21-42e3-b21d-2e6069ea2c67] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:47.871253 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-470fe274-4373-4f9e-a09f-2874761aaea1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:47.871706 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-470fe274-4373-4f9e-a09f-2874761aaea1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:47.872525 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-470fe274-4373-4f9e-a09f-2874761aaea1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:47.872967 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-470fe274-4373-4f9e-a09f-2874761aaea1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:48.090892 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-470fe274-4373-4f9e-a09f-2874761aaea1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:34:48.099000 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-470fe274-4373-4f9e-a09f-2874761aaea1 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67" status: 200 len: 1577 microversion: 2.1 time: 0.238356 Nov 20 03:34:48.099985 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 560/1188] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:34:47 2021] GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67 => generated 1577 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:34:48.278550 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-1cd9f327-5bf8-48a5-a468-6f89c79feade req-d9c02704-c4c4-452b-ba9e-4457676bef75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c45ebf32-845d-4d80-9393-0e6d2c7737e8", "name": "network-vif-plugged", "status": "completed", "tag": "24b1806d-1729-41db-a62b-40fd0907daf4"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:34:48.281667 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:34:48.281667 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:34:48.293392 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-1cd9f327-5bf8-48a5-a468-6f89c79feade req-d9c02704-c4c4-452b-ba9e-4457676bef75 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:48.293999 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-1cd9f327-5bf8-48a5-a468-6f89c79feade req-d9c02704-c4c4-452b-ba9e-4457676bef75 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:48.307129 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-1cd9f327-5bf8-48a5-a468-6f89c79feade req-d9c02704-c4c4-452b-ba9e-4457676bef75 service nova] Creating event network-vif-plugged:24b1806d-1729-41db-a62b-40fd0907daf4 for instance c45ebf32-845d-4d80-9393-0e6d2c7737e8 on hv-cinder-81803 Nov 20 03:34:48.313120 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-1cd9f327-5bf8-48a5-a468-6f89c79feade req-d9c02704-c4c4-452b-ba9e-4457676bef75 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039006 Nov 20 03:34:48.314338 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 629/1189] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:34:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:34:48.877352 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-f15cc42d-9cdf-4cae-8fd5-e9acea2bce46 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:48.877998 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-f15cc42d-9cdf-4cae-8fd5-e9acea2bce46 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:48.884363 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f15cc42d-9cdf-4cae-8fd5-e9acea2bce46 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:48.884812 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f15cc42d-9cdf-4cae-8fd5-e9acea2bce46 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:48.885588 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f15cc42d-9cdf-4cae-8fd5-e9acea2bce46 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:48.886024 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f15cc42d-9cdf-4cae-8fd5-e9acea2bce46 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:49.014132 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-f15cc42d-9cdf-4cae-8fd5-e9acea2bce46 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:34:49.023352 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-f15cc42d-9cdf-4cae-8fd5-e9acea2bce46 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8" status: 200 len: 1362 microversion: 2.1 time: 0.149705 Nov 20 03:34:49.023965 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 561/1190] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:34:48 2021] GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:34:49.116996 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-0dcac2ec-85ca-431d-a59d-a1e65788eea0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:49.117688 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-0dcac2ec-85ca-431d-a59d-a1e65788eea0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: dd695701-5d21-42e3-b21d-2e6069ea2c67] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:49.123705 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0dcac2ec-85ca-431d-a59d-a1e65788eea0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:49.124183 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0dcac2ec-85ca-431d-a59d-a1e65788eea0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:49.124941 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0dcac2ec-85ca-431d-a59d-a1e65788eea0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:49.125372 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-0dcac2ec-85ca-431d-a59d-a1e65788eea0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:49.256962 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-0dcac2ec-85ca-431d-a59d-a1e65788eea0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:34:49.264254 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-0dcac2ec-85ca-431d-a59d-a1e65788eea0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67" status: 200 len: 1460 microversion: 2.1 time: 0.151558 Nov 20 03:34:49.264817 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 630/1191] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:34:49 2021] GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67 => generated 1460 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:34:50.040725 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-f2b25ef1-a3d0-4388-8d82-f9c114db5abb tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:50.041460 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-f2b25ef1-a3d0-4388-8d82-f9c114db5abb tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:50.047937 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f2b25ef1-a3d0-4388-8d82-f9c114db5abb tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:50.048385 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f2b25ef1-a3d0-4388-8d82-f9c114db5abb tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:50.049156 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f2b25ef1-a3d0-4388-8d82-f9c114db5abb tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:50.050249 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f2b25ef1-a3d0-4388-8d82-f9c114db5abb tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:50.273591 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-f2b25ef1-a3d0-4388-8d82-f9c114db5abb tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:34:50.281087 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-f2b25ef1-a3d0-4388-8d82-f9c114db5abb tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8" status: 200 len: 1549 microversion: 2.1 time: 0.243976 Nov 20 03:34:50.282000 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 562/1192] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:34:50 2021] GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8 => generated 1549 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:34:50.282130 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-fb6172f6-40df-484d-b358-5b3432cd8472 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:50.282767 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-fb6172f6-40df-484d-b358-5b3432cd8472 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: dd695701-5d21-42e3-b21d-2e6069ea2c67] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:50.289677 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fb6172f6-40df-484d-b358-5b3432cd8472 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:50.290337 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fb6172f6-40df-484d-b358-5b3432cd8472 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:50.291132 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fb6172f6-40df-484d-b358-5b3432cd8472 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:50.291569 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fb6172f6-40df-484d-b358-5b3432cd8472 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:50.298477 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-88cddb53-45c7-4d6b-86b3-9efd8a44c1f4 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:50.298974 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-88cddb53-45c7-4d6b-86b3-9efd8a44c1f4 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:50.305293 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-88cddb53-45c7-4d6b-86b3-9efd8a44c1f4 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:50.305792 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-88cddb53-45c7-4d6b-86b3-9efd8a44c1f4 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:50.306595 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-88cddb53-45c7-4d6b-86b3-9efd8a44c1f4 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:50.307032 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-88cddb53-45c7-4d6b-86b3-9efd8a44c1f4 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:50.453953 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-88cddb53-45c7-4d6b-86b3-9efd8a44c1f4 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.159781 Nov 20 03:34:50.454580 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 563/1193] 10.222.0.37 () {58 vars in 1274 bytes} [Sat Nov 20 03:34:50 2021] GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/os-interface => generated 285 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:34:50.553886 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-fb6172f6-40df-484d-b358-5b3432cd8472 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:34:50.561378 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-fb6172f6-40df-484d-b358-5b3432cd8472 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67" status: 200 len: 1460 microversion: 2.1 time: 0.283303 Nov 20 03:34:50.562231 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 631/1194] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:34:50 2021] GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67 => generated 1460 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:34:50.642746 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-3ffe5f6b-9db3-43ff-8ee5-1a23d0e07c76 req-edc58ae8-4846-4332-9947-a3703e07f8e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd695701-5d21-42e3-b21d-2e6069ea2c67", "name": "network-vif-deleted", "tag": "b1b6c435-4da9-495a-9684-c863636515b2"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:34:50.645194 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:34:50.645194 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:34:50.652324 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-3ffe5f6b-9db3-43ff-8ee5-1a23d0e07c76 req-edc58ae8-4846-4332-9947-a3703e07f8e6 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:50.652771 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-3ffe5f6b-9db3-43ff-8ee5-1a23d0e07c76 req-edc58ae8-4846-4332-9947-a3703e07f8e6 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:50.664562 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-3ffe5f6b-9db3-43ff-8ee5-1a23d0e07c76 req-edc58ae8-4846-4332-9947-a3703e07f8e6 service nova] Creating event network-vif-deleted:b1b6c435-4da9-495a-9684-c863636515b2 for instance dd695701-5d21-42e3-b21d-2e6069ea2c67 on hv-cinder-81803 Nov 20 03:34:50.669720 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-3ffe5f6b-9db3-43ff-8ee5-1a23d0e07c76 req-edc58ae8-4846-4332-9947-a3703e07f8e6 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030594 Nov 20 03:34:50.670552 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 564/1195] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:34:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:34:51.427829 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-3f03522f-d60f-48dc-bf69-ffa15ce6eb10 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:34:51.428837 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-3f03522f-d60f-48dc-bf69-ffa15ce6eb10 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:51.432919 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-88a3d1b2-c8ef-4c6a-b2e1-469c82b9d575 req-2c873ab7-a807-4142-814f-f7215297b981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c45ebf32-845d-4d80-9393-0e6d2c7737e8", "tag": "24b1806d-1729-41db-a62b-40fd0907daf4"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:34:51.434635 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:34:51.434635 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:34:51.443487 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-88a3d1b2-c8ef-4c6a-b2e1-469c82b9d575 req-2c873ab7-a807-4142-814f-f7215297b981 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:51.444041 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-88a3d1b2-c8ef-4c6a-b2e1-469c82b9d575 req-2c873ab7-a807-4142-814f-f7215297b981 service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:51.449001 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3f03522f-d60f-48dc-bf69-ffa15ce6eb10 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:51.449886 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3f03522f-d60f-48dc-bf69-ffa15ce6eb10 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:51.450873 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3f03522f-d60f-48dc-bf69-ffa15ce6eb10 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:51.451682 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-3f03522f-d60f-48dc-bf69-ffa15ce6eb10 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:51.455949 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-88a3d1b2-c8ef-4c6a-b2e1-469c82b9d575 req-2c873ab7-a807-4142-814f-f7215297b981 service nova] Creating event network-changed:24b1806d-1729-41db-a62b-40fd0907daf4 for instance c45ebf32-845d-4d80-9393-0e6d2c7737e8 on hv-cinder-81803 Nov 20 03:34:51.461485 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-88a3d1b2-c8ef-4c6a-b2e1-469c82b9d575 req-2c873ab7-a807-4142-814f-f7215297b981 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034221 Nov 20 03:34:51.462804 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 565/1196] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:34:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:34:51.541580 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-3f03522f-d60f-48dc-bf69-ffa15ce6eb10 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 14 microversion: 2.1 time: 0.117994 Nov 20 03:34:51.542228 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 632/1197] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:34:51 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 03:34:51.579466 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-8aea54dc-59d8-4b24-b22b-bb2baee3ce36 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:51.580797 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-8aea54dc-59d8-4b24-b22b-bb2baee3ce36 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: dd695701-5d21-42e3-b21d-2e6069ea2c67] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:51.588396 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8aea54dc-59d8-4b24-b22b-bb2baee3ce36 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:51.588855 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8aea54dc-59d8-4b24-b22b-bb2baee3ce36 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:51.589658 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8aea54dc-59d8-4b24-b22b-bb2baee3ce36 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:51.590096 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8aea54dc-59d8-4b24-b22b-bb2baee3ce36 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:51.603945 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.wsgi [None req-8aea54dc-59d8-4b24-b22b-bb2baee3ce36 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] HTTP exception thrown: Instance dd695701-5d21-42e3-b21d-2e6069ea2c67 could not be found. Nov 20 03:34:51.604542 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-8aea54dc-59d8-4b24-b22b-bb2baee3ce36 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Returning 404 to user: Instance dd695701-5d21-42e3-b21d-2e6069ea2c67 could not be found. {{(pid=116114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:34:51.605371 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-8aea54dc-59d8-4b24-b22b-bb2baee3ce36 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67" status: 404 len: 111 microversion: 2.1 time: 0.029968 Nov 20 03:34:51.606102 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 566/1198] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:34:51 2021] GET /compute/v2.1/servers/dd695701-5d21-42e3-b21d-2e6069ea2c67 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 03:34:52.553611 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-34dd381d-d9d5-48d6-9261-65eda92d03f0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:34:52.554558 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-34dd381d-d9d5-48d6-9261-65eda92d03f0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:52.561816 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-34dd381d-d9d5-48d6-9261-65eda92d03f0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:52.562276 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-34dd381d-d9d5-48d6-9261-65eda92d03f0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:52.563061 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-34dd381d-d9d5-48d6-9261-65eda92d03f0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:52.563502 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-34dd381d-d9d5-48d6-9261-65eda92d03f0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:52.644146 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-34dd381d-d9d5-48d6-9261-65eda92d03f0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 14 microversion: 2.1 time: 0.094417 Nov 20 03:34:52.644840 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 633/1199] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:34:52 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 03:34:53.654682 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-28521105-ee8c-4ffb-a73d-eee99a38ced8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:34:53.655598 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-28521105-ee8c-4ffb-a73d-eee99a38ced8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:53.662626 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-28521105-ee8c-4ffb-a73d-eee99a38ced8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:53.663080 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-28521105-ee8c-4ffb-a73d-eee99a38ced8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:53.663883 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-28521105-ee8c-4ffb-a73d-eee99a38ced8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:53.664327 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-28521105-ee8c-4ffb-a73d-eee99a38ced8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:53.743351 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-28521105-ee8c-4ffb-a73d-eee99a38ced8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 14 microversion: 2.1 time: 0.092165 Nov 20 03:34:53.744064 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 567/1200] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:34:53 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 03:34:54.643686 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-8b4483bc-4650-4727-849a-dca5cc23d743 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:54.644312 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-8b4483bc-4650-4727-849a-dca5cc23d743 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:54.646858 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [req-8680b35d-543c-46c8-9436-5ae0ab0901b3 req-1286c52a-8135-474a-8c6c-9326e1dc95ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d3e9138-6765-44c1-af74-6a6d69eecdd5", "tag": "7fab1476-2c92-464e-a1e2-23830e67426c"}]} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:34:54.648706 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:34:54.648706 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: warnings.warn(msg) Nov 20 03:34:54.651976 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8b4483bc-4650-4727-849a-dca5cc23d743 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:54.652901 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8b4483bc-4650-4727-849a-dca5cc23d743 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:54.653768 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8b4483bc-4650-4727-849a-dca5cc23d743 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:54.654252 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8b4483bc-4650-4727-849a-dca5cc23d743 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:54.656710 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-8680b35d-543c-46c8-9436-5ae0ab0901b3 req-1286c52a-8135-474a-8c6c-9326e1dc95ee service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:54.657757 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [req-8680b35d-543c-46c8-9436-5ae0ab0901b3 req-1286c52a-8135-474a-8c6c-9326e1dc95ee service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:54.669716 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.compute.server_external_events [req-8680b35d-543c-46c8-9436-5ae0ab0901b3 req-1286c52a-8135-474a-8c6c-9326e1dc95ee service nova] Creating event network-changed:7fab1476-2c92-464e-a1e2-23830e67426c for instance 1d3e9138-6765-44c1-af74-6a6d69eecdd5 on hv-cinder-81803 Nov 20 03:34:54.675265 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [req-8680b35d-543c-46c8-9436-5ae0ab0901b3 req-1286c52a-8135-474a-8c6c-9326e1dc95ee service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031849 Nov 20 03:34:54.676500 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 568/1201] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:34:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:34:54.696278 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-8b4483bc-4650-4727-849a-dca5cc23d743 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Going to try to terminate instance {{(pid=116113) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 03:34:54.755119 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-05d90c52-459b-4ee9-84b8-5acde9bd8283 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:34:54.756513 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-05d90c52-459b-4ee9-84b8-5acde9bd8283 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:54.762948 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-05d90c52-459b-4ee9-84b8-5acde9bd8283 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:54.763688 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-05d90c52-459b-4ee9-84b8-5acde9bd8283 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:54.764748 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-05d90c52-459b-4ee9-84b8-5acde9bd8283 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:54.765388 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-05d90c52-459b-4ee9-84b8-5acde9bd8283 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:54.798928 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-8b4483bc-4650-4727-849a-dca5cc23d743 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "DELETE /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 204 len: 0 microversion: 2.1 time: 0.159487 Nov 20 03:34:54.802286 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 634/1202] 10.222.0.37 () {58 vars in 1238 bytes} [Sat Nov 20 03:34:54 2021] DELETE /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 03:34:54.811225 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-c3f2b524-9b95-4487-a0cb-0ae708582742 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:54.812056 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-c3f2b524-9b95-4487-a0cb-0ae708582742 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:54.818687 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c3f2b524-9b95-4487-a0cb-0ae708582742 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:54.819135 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c3f2b524-9b95-4487-a0cb-0ae708582742 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:54.819945 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c3f2b524-9b95-4487-a0cb-0ae708582742 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:54.820509 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-c3f2b524-9b95-4487-a0cb-0ae708582742 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:54.903691 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-05d90c52-459b-4ee9-84b8-5acde9bd8283 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 14 microversion: 2.1 time: 0.152814 Nov 20 03:34:54.905633 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 569/1203] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:34:54 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 20 03:34:55.049857 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-c3f2b524-9b95-4487-a0cb-0ae708582742 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:34:55.059911 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-c3f2b524-9b95-4487-a0cb-0ae708582742 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1579 microversion: 2.1 time: 0.253881 Nov 20 03:34:55.071628 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 635/1204] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:34:54 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1579 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:34:55.916209 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-09a28ddc-79b9-47f9-93fb-be94ae94c54f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:34:55.917240 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-09a28ddc-79b9-47f9-93fb-be94ae94c54f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:55.924653 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-09a28ddc-79b9-47f9-93fb-be94ae94c54f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:55.925122 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-09a28ddc-79b9-47f9-93fb-be94ae94c54f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:55.925907 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-09a28ddc-79b9-47f9-93fb-be94ae94c54f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:55.926349 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-09a28ddc-79b9-47f9-93fb-be94ae94c54f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:56.017474 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-09a28ddc-79b9-47f9-93fb-be94ae94c54f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 14 microversion: 2.1 time: 0.105262 Nov 20 03:34:56.018078 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 570/1205] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:34:55 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 03:34:56.078116 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-8a52ff3c-186c-4e48-b1da-3022a9bfb34f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:56.078716 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-8a52ff3c-186c-4e48-b1da-3022a9bfb34f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:56.085014 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8a52ff3c-186c-4e48-b1da-3022a9bfb34f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:56.085460 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8a52ff3c-186c-4e48-b1da-3022a9bfb34f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:56.086256 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8a52ff3c-186c-4e48-b1da-3022a9bfb34f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:56.086686 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8a52ff3c-186c-4e48-b1da-3022a9bfb34f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:56.215953 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-8a52ff3c-186c-4e48-b1da-3022a9bfb34f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:34:56.224081 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-8a52ff3c-186c-4e48-b1da-3022a9bfb34f tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1460 microversion: 2.1 time: 0.149586 Nov 20 03:34:56.224641 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 636/1206] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:34:56 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1460 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:34:57.028377 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-5913bac6-9800-4264-b0e8-7a7d2fce5ff7 req-48b2fb89-a500-41e0-882f-32f7e6ed7dde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d3e9138-6765-44c1-af74-6a6d69eecdd5", "name": "network-vif-deleted", "tag": "7fab1476-2c92-464e-a1e2-23830e67426c"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:34:57.028679 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-4089a63b-2626-4184-b137-2fd2a82a6a20 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:34:57.029565 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-4089a63b-2626-4184-b137-2fd2a82a6a20 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:57.029898 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:34:57.029898 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:34:57.037616 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-5913bac6-9800-4264-b0e8-7a7d2fce5ff7 req-48b2fb89-a500-41e0-882f-32f7e6ed7dde service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:57.038068 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-5913bac6-9800-4264-b0e8-7a7d2fce5ff7 req-48b2fb89-a500-41e0-882f-32f7e6ed7dde service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:57.038789 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4089a63b-2626-4184-b137-2fd2a82a6a20 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:57.039318 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4089a63b-2626-4184-b137-2fd2a82a6a20 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:57.040364 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4089a63b-2626-4184-b137-2fd2a82a6a20 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:57.040726 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4089a63b-2626-4184-b137-2fd2a82a6a20 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:57.049146 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-5913bac6-9800-4264-b0e8-7a7d2fce5ff7 req-48b2fb89-a500-41e0-882f-32f7e6ed7dde service nova] Creating event network-vif-deleted:7fab1476-2c92-464e-a1e2-23830e67426c for instance 1d3e9138-6765-44c1-af74-6a6d69eecdd5 on hv-cinder-81803 Nov 20 03:34:57.053841 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-5913bac6-9800-4264-b0e8-7a7d2fce5ff7 req-48b2fb89-a500-41e0-882f-32f7e6ed7dde service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029146 Nov 20 03:34:57.054448 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 637/1207] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:34:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 03:34:57.137553 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-4089a63b-2626-4184-b137-2fd2a82a6a20 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 14 microversion: 2.1 time: 0.113219 Nov 20 03:34:57.138266 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 571/1208] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:34:57 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 03:34:57.241638 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-f178087c-0861-449b-988c-56175e5a07a0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:57.242246 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f178087c-0861-449b-988c-56175e5a07a0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:57.248373 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f178087c-0861-449b-988c-56175e5a07a0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:57.248853 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f178087c-0861-449b-988c-56175e5a07a0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:57.249633 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f178087c-0861-449b-988c-56175e5a07a0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:57.250075 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f178087c-0861-449b-988c-56175e5a07a0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:57.310928 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-f178087c-0861-449b-988c-56175e5a07a0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2841384d235c4869bc6c39212c34f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee28f54d912d4789b1b0abf0f0cddab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:34:57.319334 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-f178087c-0861-449b-988c-56175e5a07a0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 200 len: 1226 microversion: 2.1 time: 0.082295 Nov 20 03:34:57.319942 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 638/1209] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:34:57 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:34:58.149145 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-0ec55eeb-492a-424f-9a48-1f320e43f766 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:34:58.150139 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-0ec55eeb-492a-424f-9a48-1f320e43f766 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:58.157037 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0ec55eeb-492a-424f-9a48-1f320e43f766 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:58.157437 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0ec55eeb-492a-424f-9a48-1f320e43f766 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:58.158215 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0ec55eeb-492a-424f-9a48-1f320e43f766 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:58.159292 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-0ec55eeb-492a-424f-9a48-1f320e43f766 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:58.244138 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-0ec55eeb-492a-424f-9a48-1f320e43f766 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 14 microversion: 2.1 time: 0.098905 Nov 20 03:34:58.244726 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 572/1210] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:34:58 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 03:34:58.337011 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-7b11ec16-4205-4b4f-9bf6-c76b446273c2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:58.337664 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-7b11ec16-4205-4b4f-9bf6-c76b446273c2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: 1d3e9138-6765-44c1-af74-6a6d69eecdd5] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:58.344207 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7b11ec16-4205-4b4f-9bf6-c76b446273c2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:58.344662 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7b11ec16-4205-4b4f-9bf6-c76b446273c2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:58.345439 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7b11ec16-4205-4b4f-9bf6-c76b446273c2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:58.345879 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7b11ec16-4205-4b4f-9bf6-c76b446273c2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:58.358684 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.wsgi [None req-7b11ec16-4205-4b4f-9bf6-c76b446273c2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] HTTP exception thrown: Instance 1d3e9138-6765-44c1-af74-6a6d69eecdd5 could not be found. Nov 20 03:34:58.359270 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-7b11ec16-4205-4b4f-9bf6-c76b446273c2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Returning 404 to user: Instance 1d3e9138-6765-44c1-af74-6a6d69eecdd5 could not be found. {{(pid=116113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:34:58.360114 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-7b11ec16-4205-4b4f-9bf6-c76b446273c2 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5" status: 404 len: 111 microversion: 2.1 time: 0.026764 Nov 20 03:34:58.360630 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 639/1211] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:34:58 2021] GET /compute/v2.1/servers/1d3e9138-6765-44c1-af74-6a6d69eecdd5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 03:34:58.795005 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-090cfec0-ede7-4847-bf1c-7a3b0a234e5b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:58.795588 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-090cfec0-ede7-4847-bf1c-7a3b0a234e5b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:58.803003 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-090cfec0-ede7-4847-bf1c-7a3b0a234e5b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:58.803453 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-090cfec0-ede7-4847-bf1c-7a3b0a234e5b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:58.804276 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-090cfec0-ede7-4847-bf1c-7a3b0a234e5b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:58.804728 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-090cfec0-ede7-4847-bf1c-7a3b0a234e5b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:58.818966 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.wsgi [None req-090cfec0-ede7-4847-bf1c-7a3b0a234e5b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] HTTP exception thrown: Instance f64dd34e-277a-4033-8330-d0dd481d287c could not be found. Nov 20 03:34:58.819548 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-090cfec0-ede7-4847-bf1c-7a3b0a234e5b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Returning 404 to user: Instance f64dd34e-277a-4033-8330-d0dd481d287c could not be found. {{(pid=116114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:34:58.820388 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-090cfec0-ede7-4847-bf1c-7a3b0a234e5b tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "DELETE /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 404 len: 111 microversion: 2.1 time: 0.029445 Nov 20 03:34:58.820906 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 573/1212] 10.222.0.37 () {58 vars in 1238 bytes} [Sat Nov 20 03:34:58 2021] DELETE /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:34:58.828644 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-7f859935-f3d7-4b1b-abf4-829187477f11 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:34:58.829279 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-7f859935-f3d7-4b1b-abf4-829187477f11 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] [instance: f64dd34e-277a-4033-8330-d0dd481d287c] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:58.835029 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7f859935-f3d7-4b1b-abf4-829187477f11 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:58.835472 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7f859935-f3d7-4b1b-abf4-829187477f11 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:58.836278 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7f859935-f3d7-4b1b-abf4-829187477f11 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:58.836708 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7f859935-f3d7-4b1b-abf4-829187477f11 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:58.849594 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.wsgi [None req-7f859935-f3d7-4b1b-abf4-829187477f11 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] HTTP exception thrown: Instance f64dd34e-277a-4033-8330-d0dd481d287c could not be found. Nov 20 03:34:58.850160 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-7f859935-f3d7-4b1b-abf4-829187477f11 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Returning 404 to user: Instance f64dd34e-277a-4033-8330-d0dd481d287c could not be found. {{(pid=116113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:34:58.850951 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-7f859935-f3d7-4b1b-abf4-829187477f11 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c" status: 404 len: 111 microversion: 2.1 time: 0.025997 Nov 20 03:34:58.851448 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 640/1213] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:34:58 2021] GET /compute/v2.1/servers/f64dd34e-277a-4033-8330-d0dd481d287c => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:34:59.254571 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-cc83d27b-5d70-4a9b-b109-a6b3772bbf26 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:34:59.255487 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-cc83d27b-5d70-4a9b-b109-a6b3772bbf26 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:34:59.261859 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cc83d27b-5d70-4a9b-b109-a6b3772bbf26 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:59.262313 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cc83d27b-5d70-4a9b-b109-a6b3772bbf26 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:59.263084 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cc83d27b-5d70-4a9b-b109-a6b3772bbf26 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:34:59.263515 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-cc83d27b-5d70-4a9b-b109-a6b3772bbf26 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:34:59.344187 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-cc83d27b-5d70-4a9b-b109-a6b3772bbf26 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 14 microversion: 2.1 time: 0.093193 Nov 20 03:34:59.344796 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 574/1214] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:34:59 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 03:35:00.124166 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-61cb2944-c78e-4d17-ba49-b158ea206ad0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] Calling method '.version_select at 0x7f2db19b33a0>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:35:00.142183 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-61cb2944-c78e-4d17-ba49-b158ea206ad0 tempest-TestVolumeBootPattern-651897511 tempest-TestVolumeBootPattern-651897511-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2111923564" status: 202 len: 0 microversion: 2.1 time: 0.021667 Nov 20 03:35:00.145941 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 641/1215] 10.222.0.37 () {58 vars in 1262 bytes} [Sat Nov 20 03:35:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2111923564 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:35:00.356384 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-9f9df506-db60-47af-a817-607497728b95 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:35:00.357502 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-9f9df506-db60-47af-a817-607497728b95 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:00.364949 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9f9df506-db60-47af-a817-607497728b95 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:00.365484 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9f9df506-db60-47af-a817-607497728b95 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:00.366343 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9f9df506-db60-47af-a817-607497728b95 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:00.366857 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9f9df506-db60-47af-a817-607497728b95 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:00.449473 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-9f9df506-db60-47af-a817-607497728b95 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 14 microversion: 2.1 time: 0.096961 Nov 20 03:35:00.452546 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 575/1216] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:35:00 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 03:35:01.461177 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-39bd67f4-fb2e-4925-b820-e946e8e4992c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:35:01.462075 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-39bd67f4-fb2e-4925-b820-e946e8e4992c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:01.469017 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-39bd67f4-fb2e-4925-b820-e946e8e4992c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:01.469475 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-39bd67f4-fb2e-4925-b820-e946e8e4992c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:01.470254 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-39bd67f4-fb2e-4925-b820-e946e8e4992c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:01.470694 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-39bd67f4-fb2e-4925-b820-e946e8e4992c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:01.557594 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-39bd67f4-fb2e-4925-b820-e946e8e4992c tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 14 microversion: 2.1 time: 0.100410 Nov 20 03:35:01.558425 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 642/1217] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:35:01 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 20 03:35:02.569179 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-a96a72d3-8b16-40c0-b964-c7c7af1d0a11 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:35:02.571047 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-a96a72d3-8b16-40c0-b964-c7c7af1d0a11 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:02.578132 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a96a72d3-8b16-40c0-b964-c7c7af1d0a11 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:02.578869 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a96a72d3-8b16-40c0-b964-c7c7af1d0a11 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:02.579873 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a96a72d3-8b16-40c0-b964-c7c7af1d0a11 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:02.581224 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a96a72d3-8b16-40c0-b964-c7c7af1d0a11 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:02.681403 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-a96a72d3-8b16-40c0-b964-c7c7af1d0a11 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 6573 microversion: 2.1 time: 0.115249 Nov 20 03:35:02.682065 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 576/1218] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:35:02 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 6573 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:35:03.693061 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-b60e2bd0-be69-40e2-8ffa-468be3f7d1b7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:35:03.694133 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-b60e2bd0-be69-40e2-8ffa-468be3f7d1b7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:03.701584 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b60e2bd0-be69-40e2-8ffa-468be3f7d1b7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:03.702247 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b60e2bd0-be69-40e2-8ffa-468be3f7d1b7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:03.703042 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b60e2bd0-be69-40e2-8ffa-468be3f7d1b7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:03.703476 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-b60e2bd0-be69-40e2-8ffa-468be3f7d1b7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:03.791162 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-b60e2bd0-be69-40e2-8ffa-468be3f7d1b7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 15025 microversion: 2.1 time: 0.101984 Nov 20 03:35:03.791818 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 643/1219] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:35:03 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 15025 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:35:04.803567 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-6eef3241-ee48-4729-aaf3-22d8e6bc19bf tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:35:04.804656 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-6eef3241-ee48-4729-aaf3-22d8e6bc19bf tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:04.811494 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6eef3241-ee48-4729-aaf3-22d8e6bc19bf tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:04.811984 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6eef3241-ee48-4729-aaf3-22d8e6bc19bf tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:04.812773 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6eef3241-ee48-4729-aaf3-22d8e6bc19bf tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:04.813214 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-6eef3241-ee48-4729-aaf3-22d8e6bc19bf tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:04.902279 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-6eef3241-ee48-4729-aaf3-22d8e6bc19bf tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 18498 microversion: 2.1 time: 0.102716 Nov 20 03:35:04.902572 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 577/1220] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:35:04 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 18498 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:35:05.914586 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-825da74b-a3cf-4019-86d5-f60bbe3ab559 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:35:05.915605 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-825da74b-a3cf-4019-86d5-f60bbe3ab559 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:05.922498 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-825da74b-a3cf-4019-86d5-f60bbe3ab559 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:05.922953 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-825da74b-a3cf-4019-86d5-f60bbe3ab559 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:05.923808 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-825da74b-a3cf-4019-86d5-f60bbe3ab559 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:05.924781 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-825da74b-a3cf-4019-86d5-f60bbe3ab559 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:06.029530 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-825da74b-a3cf-4019-86d5-f60bbe3ab559 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 20148 microversion: 2.1 time: 0.119030 Nov 20 03:35:06.030394 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 644/1221] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:35:05 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 20148 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:35:07.040844 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-7b39437c-c4d3-4453-91b6-3d047bec38a6 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:35:07.041835 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-7b39437c-c4d3-4453-91b6-3d047bec38a6 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:07.048593 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7b39437c-c4d3-4453-91b6-3d047bec38a6 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:07.049536 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7b39437c-c4d3-4453-91b6-3d047bec38a6 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:07.050308 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7b39437c-c4d3-4453-91b6-3d047bec38a6 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:07.050816 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7b39437c-c4d3-4453-91b6-3d047bec38a6 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:07.139089 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-7b39437c-c4d3-4453-91b6-3d047bec38a6 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 22721 microversion: 2.1 time: 0.102032 Nov 20 03:35:07.142920 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 578/1222] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:35:07 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 22721 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:35:08.151090 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-e662d76f-1668-4339-bd94-8e82a51905f0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:35:08.152180 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-e662d76f-1668-4339-bd94-8e82a51905f0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:08.158888 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e662d76f-1668-4339-bd94-8e82a51905f0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:08.159338 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e662d76f-1668-4339-bd94-8e82a51905f0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:08.160141 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e662d76f-1668-4339-bd94-8e82a51905f0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:08.160573 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e662d76f-1668-4339-bd94-8e82a51905f0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:08.249557 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-e662d76f-1668-4339-bd94-8e82a51905f0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 24384 microversion: 2.1 time: 0.101894 Nov 20 03:35:08.250297 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 645/1223] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:35:08 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 24384 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:35:09.262029 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-9eed4b95-e303-4184-ae7d-5d01c0c9afbd tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:35:09.263033 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-9eed4b95-e303-4184-ae7d-5d01c0c9afbd tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:09.270428 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9eed4b95-e303-4184-ae7d-5d01c0c9afbd tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:09.270885 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9eed4b95-e303-4184-ae7d-5d01c0c9afbd tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:09.271667 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9eed4b95-e303-4184-ae7d-5d01c0c9afbd tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:09.272211 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-9eed4b95-e303-4184-ae7d-5d01c0c9afbd tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:09.362288 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-9eed4b95-e303-4184-ae7d-5d01c0c9afbd tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 26032 microversion: 2.1 time: 0.104226 Nov 20 03:35:09.362907 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 579/1224] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:35:09 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 26032 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:35:10.373539 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-17526c5b-f203-48bf-ab3f-fc6cf5f14904 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:35:10.374543 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-17526c5b-f203-48bf-ab3f-fc6cf5f14904 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:10.381895 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-17526c5b-f203-48bf-ab3f-fc6cf5f14904 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:10.382357 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-17526c5b-f203-48bf-ab3f-fc6cf5f14904 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:10.383139 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-17526c5b-f203-48bf-ab3f-fc6cf5f14904 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:10.383583 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-17526c5b-f203-48bf-ab3f-fc6cf5f14904 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:10.476755 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-17526c5b-f203-48bf-ab3f-fc6cf5f14904 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 27271 microversion: 2.1 time: 0.107197 Nov 20 03:35:10.477370 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 646/1225] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:35:10 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 27271 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:35:11.488601 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-f328d7f2-1967-41b2-be35-38d7e04f77d3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:35:11.489630 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-f328d7f2-1967-41b2-be35-38d7e04f77d3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:11.496566 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f328d7f2-1967-41b2-be35-38d7e04f77d3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:11.497020 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f328d7f2-1967-41b2-be35-38d7e04f77d3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:11.497807 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f328d7f2-1967-41b2-be35-38d7e04f77d3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:11.498245 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-f328d7f2-1967-41b2-be35-38d7e04f77d3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:11.589769 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-f328d7f2-1967-41b2-be35-38d7e04f77d3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 27921 microversion: 2.1 time: 0.105165 Nov 20 03:35:11.590423 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 580/1226] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:35:11 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 27921 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:35:12.603419 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-fcbad8af-0858-4d82-ba5e-5791b9963560 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:35:12.604379 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-fcbad8af-0858-4d82-ba5e-5791b9963560 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:12.611835 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fcbad8af-0858-4d82-ba5e-5791b9963560 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:12.612293 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fcbad8af-0858-4d82-ba5e-5791b9963560 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:12.613073 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fcbad8af-0858-4d82-ba5e-5791b9963560 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:12.613509 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-fcbad8af-0858-4d82-ba5e-5791b9963560 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:12.704019 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-fcbad8af-0858-4d82-ba5e-5791b9963560 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 28217 microversion: 2.1 time: 0.104461 Nov 20 03:35:12.704740 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 647/1227] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:35:12 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 28217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:35:13.716137 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-2c78da1c-bcc9-4ea9-a6f3-ec7ad62ab13e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:35:13.717126 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-2c78da1c-bcc9-4ea9-a6f3-ec7ad62ab13e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:13.724864 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2c78da1c-bcc9-4ea9-a6f3-ec7ad62ab13e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:13.725314 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2c78da1c-bcc9-4ea9-a6f3-ec7ad62ab13e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:13.726106 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2c78da1c-bcc9-4ea9-a6f3-ec7ad62ab13e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:13.726540 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2c78da1c-bcc9-4ea9-a6f3-ec7ad62ab13e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:13.812156 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-2c78da1c-bcc9-4ea9-a6f3-ec7ad62ab13e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 28217 microversion: 2.1 time: 0.099908 Nov 20 03:35:13.813098 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 581/1228] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:35:13 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 28217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:35:14.823231 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-92fd5a05-f231-4f5d-bf6d-3ecb4cf218a8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:35:14.824260 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-92fd5a05-f231-4f5d-bf6d-3ecb4cf218a8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:14.831011 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-92fd5a05-f231-4f5d-bf6d-3ecb4cf218a8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:14.831485 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-92fd5a05-f231-4f5d-bf6d-3ecb4cf218a8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:14.832270 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-92fd5a05-f231-4f5d-bf6d-3ecb4cf218a8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:14.832700 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-92fd5a05-f231-4f5d-bf6d-3ecb4cf218a8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:14.927008 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-92fd5a05-f231-4f5d-bf6d-3ecb4cf218a8 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 28507 microversion: 2.1 time: 0.107603 Nov 20 03:35:14.927657 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 648/1229] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:35:14 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 28507 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:35:15.938419 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-42f762fc-58df-4663-bd2d-85c6f82b055a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:35:15.939522 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-42f762fc-58df-4663-bd2d-85c6f82b055a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:15.946492 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-42f762fc-58df-4663-bd2d-85c6f82b055a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:15.946881 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-42f762fc-58df-4663-bd2d-85c6f82b055a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:15.947672 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-42f762fc-58df-4663-bd2d-85c6f82b055a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:15.948141 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-42f762fc-58df-4663-bd2d-85c6f82b055a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:16.040385 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-42f762fc-58df-4663-bd2d-85c6f82b055a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 28675 microversion: 2.1 time: 0.105922 Nov 20 03:35:16.041021 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 582/1230] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:35:15 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 28675 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:35:17.052519 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-751c93e9-7d09-44fe-84c0-e569afa63c89 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:35:17.053505 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-751c93e9-7d09-44fe-84c0-e569afa63c89 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:17.060242 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-751c93e9-7d09-44fe-84c0-e569afa63c89 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:17.060687 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-751c93e9-7d09-44fe-84c0-e569afa63c89 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:17.061451 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-751c93e9-7d09-44fe-84c0-e569afa63c89 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:17.061878 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-751c93e9-7d09-44fe-84c0-e569afa63c89 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:17.146760 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-751c93e9-7d09-44fe-84c0-e569afa63c89 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 28675 microversion: 2.1 time: 0.098093 Nov 20 03:35:17.147361 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 649/1231] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:35:17 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 28675 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:35:18.159355 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-294e9cbe-a114-42a4-b1ed-200552dde502 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:35:18.160313 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-294e9cbe-a114-42a4-b1ed-200552dde502 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:18.167165 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-294e9cbe-a114-42a4-b1ed-200552dde502 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:18.167619 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-294e9cbe-a114-42a4-b1ed-200552dde502 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:18.168505 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-294e9cbe-a114-42a4-b1ed-200552dde502 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:18.168941 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-294e9cbe-a114-42a4-b1ed-200552dde502 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:18.267629 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-294e9cbe-a114-42a4-b1ed-200552dde502 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 28700 microversion: 2.1 time: 0.112892 Nov 20 03:35:18.268778 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 583/1232] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:35:18 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 28700 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:35:19.280118 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-f4523857-6b36-4090-a763-e70f16d11184 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:35:19.281025 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f4523857-6b36-4090-a763-e70f16d11184 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:19.287777 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f4523857-6b36-4090-a763-e70f16d11184 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:19.288248 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f4523857-6b36-4090-a763-e70f16d11184 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:19.289016 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f4523857-6b36-4090-a763-e70f16d11184 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:19.289450 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f4523857-6b36-4090-a763-e70f16d11184 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:19.380955 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-f4523857-6b36-4090-a763-e70f16d11184 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 30914 microversion: 2.1 time: 0.104789 Nov 20 03:35:19.381586 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 650/1233] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:35:19 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 30914 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:35:20.392537 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-b7914bf8-1b9d-49b2-816a-1edd2cebf77a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:35:20.394181 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-b7914bf8-1b9d-49b2-816a-1edd2cebf77a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:20.401019 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b7914bf8-1b9d-49b2-816a-1edd2cebf77a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:20.401468 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b7914bf8-1b9d-49b2-816a-1edd2cebf77a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:20.402237 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b7914bf8-1b9d-49b2-816a-1edd2cebf77a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:20.402666 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b7914bf8-1b9d-49b2-816a-1edd2cebf77a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:20.491052 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-b7914bf8-1b9d-49b2-816a-1edd2cebf77a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 32495 microversion: 2.1 time: 0.102377 Nov 20 03:35:20.491705 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 584/1234] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:35:20 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 32495 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:35:21.503055 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-2a14ea78-f094-4488-aa21-b83f0f152a56 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:35:21.504067 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-2a14ea78-f094-4488-aa21-b83f0f152a56 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:21.510788 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2a14ea78-f094-4488-aa21-b83f0f152a56 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:21.511232 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2a14ea78-f094-4488-aa21-b83f0f152a56 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:21.512024 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2a14ea78-f094-4488-aa21-b83f0f152a56 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:21.512458 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-2a14ea78-f094-4488-aa21-b83f0f152a56 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:21.601039 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-2a14ea78-f094-4488-aa21-b83f0f152a56 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 33508 microversion: 2.1 time: 0.101852 Nov 20 03:35:21.601651 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 651/1235] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:35:21 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 33508 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:35:22.613722 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-7637eaab-3db8-4da1-a33a-2c2a8e6799f5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:35:22.614636 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-7637eaab-3db8-4da1-a33a-2c2a8e6799f5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:22.621467 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7637eaab-3db8-4da1-a33a-2c2a8e6799f5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:22.621912 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7637eaab-3db8-4da1-a33a-2c2a8e6799f5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:22.622676 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7637eaab-3db8-4da1-a33a-2c2a8e6799f5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:22.623109 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7637eaab-3db8-4da1-a33a-2c2a8e6799f5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:22.715771 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-7637eaab-3db8-4da1-a33a-2c2a8e6799f5 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 34904 microversion: 2.1 time: 0.106492 Nov 20 03:35:22.716427 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 585/1236] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:35:22 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 34904 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 03:35:23.728100 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-f9623302-de08-4604-831e-5d7137b174eb tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:35:23.729092 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f9623302-de08-4604-831e-5d7137b174eb tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:23.735833 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f9623302-de08-4604-831e-5d7137b174eb tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:23.736885 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f9623302-de08-4604-831e-5d7137b174eb tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:23.737666 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f9623302-de08-4604-831e-5d7137b174eb tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:23.738095 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f9623302-de08-4604-831e-5d7137b174eb tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:23.826478 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-f9623302-de08-4604-831e-5d7137b174eb tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 36338 microversion: 2.1 time: 0.102198 Nov 20 03:35:23.831006 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 652/1237] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:35:23 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 36338 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:35:24.838591 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-a53eabaf-04eb-41be-ab2d-a16f598cae95 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:35:24.839595 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-a53eabaf-04eb-41be-ab2d-a16f598cae95 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:24.846858 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a53eabaf-04eb-41be-ab2d-a16f598cae95 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:24.847347 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a53eabaf-04eb-41be-ab2d-a16f598cae95 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:24.848160 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a53eabaf-04eb-41be-ab2d-a16f598cae95 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:24.848605 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-a53eabaf-04eb-41be-ab2d-a16f598cae95 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:24.936541 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-a53eabaf-04eb-41be-ab2d-a16f598cae95 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 37913 microversion: 2.1 time: 0.101810 Nov 20 03:35:24.937489 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 586/1238] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:35:24 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 37913 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:35:25.949480 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-153c12cc-f648-4c93-b035-6e3fa40cbebc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:35:25.950515 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-153c12cc-f648-4c93-b035-6e3fa40cbebc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:25.957390 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-153c12cc-f648-4c93-b035-6e3fa40cbebc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:25.957844 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-153c12cc-f648-4c93-b035-6e3fa40cbebc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:25.958616 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-153c12cc-f648-4c93-b035-6e3fa40cbebc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:25.959058 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-153c12cc-f648-4c93-b035-6e3fa40cbebc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:26.048452 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-153c12cc-f648-4c93-b035-6e3fa40cbebc tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 38206 microversion: 2.1 time: 0.102882 Nov 20 03:35:26.049664 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 653/1239] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:35:25 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 38206 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:35:27.061269 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-4a0b1480-bdbf-40f3-91c5-f7a13292029a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:35:27.062279 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-4a0b1480-bdbf-40f3-91c5-f7a13292029a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:27.069134 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4a0b1480-bdbf-40f3-91c5-f7a13292029a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:27.069589 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4a0b1480-bdbf-40f3-91c5-f7a13292029a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:27.070372 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4a0b1480-bdbf-40f3-91c5-f7a13292029a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:27.070808 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-4a0b1480-bdbf-40f3-91c5-f7a13292029a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:27.154390 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-4a0b1480-bdbf-40f3-91c5-f7a13292029a tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 38206 microversion: 2.1 time: 0.096934 Nov 20 03:35:27.155250 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 587/1240] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:35:27 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 38206 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:35:28.167244 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-7c4194a0-b852-42ff-b84f-1112a17afd8d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:35:28.168212 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-7c4194a0-b852-42ff-b84f-1112a17afd8d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:28.175077 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7c4194a0-b852-42ff-b84f-1112a17afd8d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:28.175535 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7c4194a0-b852-42ff-b84f-1112a17afd8d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:28.176350 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7c4194a0-b852-42ff-b84f-1112a17afd8d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:28.176795 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-7c4194a0-b852-42ff-b84f-1112a17afd8d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:28.263035 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-7c4194a0-b852-42ff-b84f-1112a17afd8d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 38206 microversion: 2.1 time: 0.099816 Nov 20 03:35:28.263658 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 654/1241] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:35:28 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 38206 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:35:29.275947 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-b165cbb7-4119-4535-9201-ea5dd4dac20d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:35:29.276872 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-b165cbb7-4119-4535-9201-ea5dd4dac20d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:29.283700 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b165cbb7-4119-4535-9201-ea5dd4dac20d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:29.284187 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b165cbb7-4119-4535-9201-ea5dd4dac20d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:29.284968 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b165cbb7-4119-4535-9201-ea5dd4dac20d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:29.285410 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-b165cbb7-4119-4535-9201-ea5dd4dac20d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:29.372597 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-b165cbb7-4119-4535-9201-ea5dd4dac20d tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action" status: 200 len: 38335 microversion: 2.1 time: 0.100701 Nov 20 03:35:29.373248 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 588/1242] 10.222.0.37 () {60 vars in 1277 bytes} [Sat Nov 20 03:35:29 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/action => generated 38335 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 03:35:29.383298 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-31be0dee-dbc0-43c8-b6bd-949b5e4e6408 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:35:29.383915 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-31be0dee-dbc0-43c8-b6bd-949b5e4e6408 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:29.390684 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-31be0dee-dbc0-43c8-b6bd-949b5e4e6408 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:29.391132 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-31be0dee-dbc0-43c8-b6bd-949b5e4e6408 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:29.391935 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-31be0dee-dbc0-43c8-b6bd-949b5e4e6408 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:29.392371 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-31be0dee-dbc0-43c8-b6bd-949b5e4e6408 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:29.416336 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-31be0dee-dbc0-43c8-b6bd-949b5e4e6408 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/ips" status: 200 len: 147 microversion: 2.1 time: 0.037108 Nov 20 03:35:29.416876 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 655/1243] 10.222.0.37 () {58 vars in 1247 bytes} [Sat Nov 20 03:35:29 2021] GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/ips => generated 147 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:35:30.708341 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-7a8e3951-21c4-4e71-b805-3190962f8168 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5382eead-481c-4336-a1d4-cdb4214a69bb"}} {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:35:30.709518 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-7a8e3951-21c4-4e71-b805-3190962f8168 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:30.716360 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7a8e3951-21c4-4e71-b805-3190962f8168 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:30.716817 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7a8e3951-21c4-4e71-b805-3190962f8168 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:30.717856 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7a8e3951-21c4-4e71-b805-3190962f8168 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:30.718295 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-7a8e3951-21c4-4e71-b805-3190962f8168 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:30.960050 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-7a8e3951-21c4-4e71-b805-3190962f8168 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255705 Nov 20 03:35:30.960681 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 589/1244] 10.222.0.37 () {60 vars in 1322 bytes} [Sat Nov 20 03:35:30 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:35:38.414838 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-4566531f-be22-41b8-8ba8-def1ec36f26e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:35:38.415892 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-4566531f-be22-41b8-8ba8-def1ec36f26e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:38.422181 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4566531f-be22-41b8-8ba8-def1ec36f26e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:38.422629 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4566531f-be22-41b8-8ba8-def1ec36f26e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:38.423425 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4566531f-be22-41b8-8ba8-def1ec36f26e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:38.423893 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4566531f-be22-41b8-8ba8-def1ec36f26e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:38.452671 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-4566531f-be22-41b8-8ba8-def1ec36f26e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042197 Nov 20 03:35:38.453212 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 656/1245] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:35:38 2021] GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:35:38.464906 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-d4018089-ac44-445a-84dc-e7931d70d34f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:35:38.465491 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-d4018089-ac44-445a-84dc-e7931d70d34f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:38.471838 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d4018089-ac44-445a-84dc-e7931d70d34f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:38.472301 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d4018089-ac44-445a-84dc-e7931d70d34f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:38.473725 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d4018089-ac44-445a-84dc-e7931d70d34f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:38.474164 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-d4018089-ac44-445a-84dc-e7931d70d34f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:38.503388 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-d4018089-ac44-445a-84dc-e7931d70d34f tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/os-volume_attachments/5382eead-481c-4336-a1d4-cdb4214a69bb" status: 200 len: 194 microversion: 2.1 time: 0.043062 Nov 20 03:35:38.504008 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 590/1246] 10.222.0.37 () {58 vars in 1412 bytes} [Sat Nov 20 03:35:38 2021] GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/os-volume_attachments/5382eead-481c-4336-a1d4-cdb4214a69bb => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:35:39.796803 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-cc767ad3-01db-471b-8049-9263ac3f09b6 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4fa029d7-ebb0-4b9d-af83-0568bd1ed88d"}} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:35:39.797862 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-cc767ad3-01db-471b-8049-9263ac3f09b6 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:39.804608 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cc767ad3-01db-471b-8049-9263ac3f09b6 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:39.805065 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cc767ad3-01db-471b-8049-9263ac3f09b6 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:39.805845 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cc767ad3-01db-471b-8049-9263ac3f09b6 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:39.806287 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-cc767ad3-01db-471b-8049-9263ac3f09b6 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:40.050497 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-cc767ad3-01db-471b-8049-9263ac3f09b6 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257288 Nov 20 03:35:40.051689 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 657/1247] 10.222.0.37 () {60 vars in 1322 bytes} [Sat Nov 20 03:35:39 2021] POST /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:35:47.502600 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-00c15e2a-768b-47dc-ad63-5ade8b0272a0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:35:47.504217 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-00c15e2a-768b-47dc-ad63-5ade8b0272a0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:35:47.510476 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-00c15e2a-768b-47dc-ad63-5ade8b0272a0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:47.510927 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-00c15e2a-768b-47dc-ad63-5ade8b0272a0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:47.511697 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-00c15e2a-768b-47dc-ad63-5ade8b0272a0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:35:47.512232 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-00c15e2a-768b-47dc-ad63-5ade8b0272a0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:35:47.542698 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-00c15e2a-768b-47dc-ad63-5ade8b0272a0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043801 Nov 20 03:35:47.543254 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 591/1248] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:35:47 2021] GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:35:59.137504 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 03:35:59.137997 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: Sat Nov 20 03:35:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 03:36:03.151863 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-e1031fd6-7c24-42df-95dd-4a29b6985d79 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:36:03.152594 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-e1031fd6-7c24-42df-95dd-4a29b6985d79 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:36:03.158607 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e1031fd6-7c24-42df-95dd-4a29b6985d79 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:03.159058 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e1031fd6-7c24-42df-95dd-4a29b6985d79 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:03.159858 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e1031fd6-7c24-42df-95dd-4a29b6985d79 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:03.160304 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-e1031fd6-7c24-42df-95dd-4a29b6985d79 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:03.188371 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-e1031fd6-7c24-42df-95dd-4a29b6985d79 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/os-volume_attachments/5382eead-481c-4336-a1d4-cdb4214a69bb" status: 200 len: 194 microversion: 2.1 time: 0.041259 Nov 20 03:36:03.188929 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 658/1249] 10.222.0.37 () {58 vars in 1412 bytes} [Sat Nov 20 03:36:03 2021] GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/os-volume_attachments/5382eead-481c-4336-a1d4-cdb4214a69bb => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:36:03.199217 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-1b340370-db33-40cf-a0e2-504a3fac6be9 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:36:03.199701 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-1b340370-db33-40cf-a0e2-504a3fac6be9 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:36:03.205705 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1b340370-db33-40cf-a0e2-504a3fac6be9 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:03.206160 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1b340370-db33-40cf-a0e2-504a3fac6be9 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:03.206937 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1b340370-db33-40cf-a0e2-504a3fac6be9 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:03.207383 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-1b340370-db33-40cf-a0e2-504a3fac6be9 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:03.282480 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.objects.instance [None req-1b340370-db33-40cf-a0e2-504a3fac6be9 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lazy-loading 'services' on Instance uuid c45ebf32-845d-4d80-9393-0e6d2c7737e8 {{(pid=116114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 03:36:03.349695 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-1b340370-db33-40cf-a0e2-504a3fac6be9 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "DELETE /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/os-volume_attachments/5382eead-481c-4336-a1d4-cdb4214a69bb" status: 202 len: 0 microversion: 2.1 time: 0.153470 Nov 20 03:36:03.350342 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 592/1250] 10.222.0.37 () {58 vars in 1415 bytes} [Sat Nov 20 03:36:03 2021] DELETE /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/os-volume_attachments/5382eead-481c-4336-a1d4-cdb4214a69bb => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:36:04.460030 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-f8e2cb3d-dea7-4cf7-bd52-7259cd8e5c8e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:36:04.460591 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-f8e2cb3d-dea7-4cf7-bd52-7259cd8e5c8e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:36:04.466794 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f8e2cb3d-dea7-4cf7-bd52-7259cd8e5c8e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:04.467501 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f8e2cb3d-dea7-4cf7-bd52-7259cd8e5c8e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:04.468316 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f8e2cb3d-dea7-4cf7-bd52-7259cd8e5c8e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:04.468740 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-f8e2cb3d-dea7-4cf7-bd52-7259cd8e5c8e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:04.496609 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-f8e2cb3d-dea7-4cf7-bd52-7259cd8e5c8e tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/os-volume_attachments/4fa029d7-ebb0-4b9d-af83-0568bd1ed88d" status: 200 len: 194 microversion: 2.1 time: 0.040987 Nov 20 03:36:04.497177 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 659/1251] 10.222.0.37 () {58 vars in 1412 bytes} [Sat Nov 20 03:36:04 2021] GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/os-volume_attachments/4fa029d7-ebb0-4b9d-af83-0568bd1ed88d => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:36:04.508297 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-2c1b04bc-1857-492b-9cbb-afa15fdb10e3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:36:04.508909 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-2c1b04bc-1857-492b-9cbb-afa15fdb10e3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:36:04.514926 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2c1b04bc-1857-492b-9cbb-afa15fdb10e3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:04.515379 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2c1b04bc-1857-492b-9cbb-afa15fdb10e3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:04.516205 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2c1b04bc-1857-492b-9cbb-afa15fdb10e3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:04.516643 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-2c1b04bc-1857-492b-9cbb-afa15fdb10e3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:04.591995 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.objects.instance [None req-2c1b04bc-1857-492b-9cbb-afa15fdb10e3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lazy-loading 'services' on Instance uuid c45ebf32-845d-4d80-9393-0e6d2c7737e8 {{(pid=116114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 03:36:04.658979 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-2c1b04bc-1857-492b-9cbb-afa15fdb10e3 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "DELETE /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/os-volume_attachments/4fa029d7-ebb0-4b9d-af83-0568bd1ed88d" status: 202 len: 0 microversion: 2.1 time: 0.155853 Nov 20 03:36:04.659712 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 593/1252] 10.222.0.37 () {58 vars in 1415 bytes} [Sat Nov 20 03:36:04 2021] DELETE /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/os-volume_attachments/4fa029d7-ebb0-4b9d-af83-0568bd1ed88d => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:36:05.811393 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-270f0462-ef7e-45a3-b712-6aa52b867ca6 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:36:05.812398 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-270f0462-ef7e-45a3-b712-6aa52b867ca6 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:36:05.818539 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-270f0462-ef7e-45a3-b712-6aa52b867ca6 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:05.818980 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-270f0462-ef7e-45a3-b712-6aa52b867ca6 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:05.819740 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-270f0462-ef7e-45a3-b712-6aa52b867ca6 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:05.820193 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-270f0462-ef7e-45a3-b712-6aa52b867ca6 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:05.847579 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-270f0462-ef7e-45a3-b712-6aa52b867ca6 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039891 Nov 20 03:36:05.848215 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 660/1253] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:36:05 2021] GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 03:36:05.945098 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-8b6a7db5-392c-4c0d-a57f-f6470da1a5be tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:36:05.946090 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-8b6a7db5-392c-4c0d-a57f-f6470da1a5be tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:36:05.952195 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8b6a7db5-392c-4c0d-a57f-f6470da1a5be tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:05.952650 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8b6a7db5-392c-4c0d-a57f-f6470da1a5be tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:05.953419 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8b6a7db5-392c-4c0d-a57f-f6470da1a5be tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:05.953853 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8b6a7db5-392c-4c0d-a57f-f6470da1a5be tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:05.983141 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-8b6a7db5-392c-4c0d-a57f-f6470da1a5be tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042584 Nov 20 03:36:05.983614 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 594/1254] 10.222.0.37 () {58 vars in 1301 bytes} [Sat Nov 20 03:36:05 2021] GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 03:36:06.035498 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-8c313cbd-6451-44b9-ac77-9cf297563813 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:36:06.036022 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-8c313cbd-6451-44b9-ac77-9cf297563813 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:36:06.042260 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8c313cbd-6451-44b9-ac77-9cf297563813 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:06.042705 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8c313cbd-6451-44b9-ac77-9cf297563813 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:06.043469 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8c313cbd-6451-44b9-ac77-9cf297563813 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:06.043932 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-8c313cbd-6451-44b9-ac77-9cf297563813 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:06.067042 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-8c313cbd-6451-44b9-ac77-9cf297563813 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Going to try to terminate instance {{(pid=116113) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 03:36:06.138071 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-8c313cbd-6451-44b9-ac77-9cf297563813 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "DELETE /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8" status: 204 len: 0 microversion: 2.1 time: 0.105759 Nov 20 03:36:06.138855 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 661/1255] 10.222.0.37 () {58 vars in 1238 bytes} [Sat Nov 20 03:36:06 2021] DELETE /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 03:36:06.148946 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-bf1e3909-7d1e-47ec-a38f-7edafe2780d4 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:36:06.149559 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-bf1e3909-7d1e-47ec-a38f-7edafe2780d4 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:36:06.155457 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bf1e3909-7d1e-47ec-a38f-7edafe2780d4 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:06.155938 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bf1e3909-7d1e-47ec-a38f-7edafe2780d4 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:06.156712 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bf1e3909-7d1e-47ec-a38f-7edafe2780d4 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:06.157147 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-bf1e3909-7d1e-47ec-a38f-7edafe2780d4 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:06.285412 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-bf1e3909-7d1e-47ec-a38f-7edafe2780d4 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:36:06.293319 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-bf1e3909-7d1e-47ec-a38f-7edafe2780d4 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8" status: 200 len: 1674 microversion: 2.1 time: 0.148822 Nov 20 03:36:06.293877 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 595/1256] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:36:06 2021] GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:36:07.310955 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-49e8d4b3-d0f1-4c47-af31-9a7c8a0989e2 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:36:07.311604 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-49e8d4b3-d0f1-4c47-af31-9a7c8a0989e2 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:36:07.318275 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-49e8d4b3-d0f1-4c47-af31-9a7c8a0989e2 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:07.318714 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-49e8d4b3-d0f1-4c47-af31-9a7c8a0989e2 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:07.319492 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-49e8d4b3-d0f1-4c47-af31-9a7c8a0989e2 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:07.319935 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-49e8d4b3-d0f1-4c47-af31-9a7c8a0989e2 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:07.451339 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.policy [None req-49e8d4b3-d0f1-4c47-af31-9a7c8a0989e2 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116113) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:36:07.459129 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-49e8d4b3-d0f1-4c47-af31-9a7c8a0989e2 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8" status: 200 len: 1674 microversion: 2.1 time: 0.152280 Nov 20 03:36:07.459681 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 662/1257] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:36:07 2021] GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:36:08.477117 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-8dc14a7b-6799-46fc-9119-0d4cf2952ec7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:36:08.477715 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-8dc14a7b-6799-46fc-9119-0d4cf2952ec7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:36:08.484065 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8dc14a7b-6799-46fc-9119-0d4cf2952ec7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:08.484519 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8dc14a7b-6799-46fc-9119-0d4cf2952ec7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:08.485304 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8dc14a7b-6799-46fc-9119-0d4cf2952ec7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:08.485740 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-8dc14a7b-6799-46fc-9119-0d4cf2952ec7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:08.567672 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-8dc14a7b-6799-46fc-9119-0d4cf2952ec7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:36:08.579690 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-8dc14a7b-6799-46fc-9119-0d4cf2952ec7 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8" status: 200 len: 1607 microversion: 2.1 time: 0.106896 Nov 20 03:36:08.580306 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 596/1258] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:36:08 2021] GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8 => generated 1607 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 03:36:09.115356 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [req-eaf82c02-0dde-4366-8ebf-b08859456dcf req-a9229c43-e603-4c92-b400-ab0e79deb83a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c45ebf32-845d-4d80-9393-0e6d2c7737e8", "name": "network-vif-deleted", "tag": "24b1806d-1729-41db-a62b-40fd0907daf4"}]} {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 03:36:09.117614 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 03:36:09.117614 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: warnings.warn(msg) Nov 20 03:36:09.124630 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-eaf82c02-0dde-4366-8ebf-b08859456dcf req-a9229c43-e603-4c92-b400-ab0e79deb83a service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:09.125072 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [req-eaf82c02-0dde-4366-8ebf-b08859456dcf req-a9229c43-e603-4c92-b400-ab0e79deb83a service nova] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:09.137255 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.compute.server_external_events [req-eaf82c02-0dde-4366-8ebf-b08859456dcf req-a9229c43-e603-4c92-b400-ab0e79deb83a service nova] Creating event network-vif-deleted:24b1806d-1729-41db-a62b-40fd0907daf4 for instance c45ebf32-845d-4d80-9393-0e6d2c7737e8 on hv-cinder-81803 Nov 20 03:36:09.142704 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [req-eaf82c02-0dde-4366-8ebf-b08859456dcf req-a9229c43-e603-4c92-b400-ab0e79deb83a service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031723 Nov 20 03:36:09.143659 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 663/1259] 10.222.0.37 () {64 vars in 1317 bytes} [Sat Nov 20 03:36:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 03:36:09.602119 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-3f5cbcf2-ac67-47d2-be1b-88a2479091c0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:36:09.602803 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-3f5cbcf2-ac67-47d2-be1b-88a2479091c0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:36:09.609112 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3f5cbcf2-ac67-47d2-be1b-88a2479091c0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:09.609877 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3f5cbcf2-ac67-47d2-be1b-88a2479091c0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:09.610667 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3f5cbcf2-ac67-47d2-be1b-88a2479091c0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:09.611267 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3f5cbcf2-ac67-47d2-be1b-88a2479091c0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:09.651411 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3f5cbcf2-ac67-47d2-be1b-88a2479091c0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:09.652072 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-3f5cbcf2-ac67-47d2-be1b-88a2479091c0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:09.652566 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.objects.instance [None req-3f5cbcf2-ac67-47d2-be1b-88a2479091c0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lazy-loading 'fault' on Instance uuid c45ebf32-845d-4d80-9393-0e6d2c7737e8 {{(pid=116114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 03:36:09.696888 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.policy [None req-3f5cbcf2-ac67-47d2-be1b-88a2479091c0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcb25cdee1f450d8c29a1f2b0ea60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08399259f414676ab07f0c72210e61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116114) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 03:36:09.704118 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-3f5cbcf2-ac67-47d2-be1b-88a2479091c0 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8" status: 200 len: 1327 microversion: 2.1 time: 0.106255 Nov 20 03:36:09.704685 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 597/1260] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:36:09 2021] GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8 => generated 1327 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 03:36:10.723194 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-6228db1d-25b4-4669-92ce-4ebd40931a05 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:36:10.723949 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-6228db1d-25b4-4669-92ce-4ebd40931a05 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:36:10.730008 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6228db1d-25b4-4669-92ce-4ebd40931a05 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:10.730463 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6228db1d-25b4-4669-92ce-4ebd40931a05 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:10.731242 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6228db1d-25b4-4669-92ce-4ebd40931a05 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:10.731688 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6228db1d-25b4-4669-92ce-4ebd40931a05 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:10.745028 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.wsgi [None req-6228db1d-25b4-4669-92ce-4ebd40931a05 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] HTTP exception thrown: Instance c45ebf32-845d-4d80-9393-0e6d2c7737e8 could not be found. Nov 20 03:36:10.745599 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-6228db1d-25b4-4669-92ce-4ebd40931a05 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Returning 404 to user: Instance c45ebf32-845d-4d80-9393-0e6d2c7737e8 could not be found. {{(pid=116113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:36:10.746401 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-6228db1d-25b4-4669-92ce-4ebd40931a05 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8" status: 404 len: 111 microversion: 2.1 time: 0.027750 Nov 20 03:36:10.746908 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 664/1261] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:36:10 2021] GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:36:10.755494 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-a8bfd476-98ba-43d2-baa1-e433320069bf tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '.version_select at 0x7f2dac92d160>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:36:10.772008 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-a8bfd476-98ba-43d2-baa1-e433320069bf tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2137808715" status: 202 len: 0 microversion: 2.1 time: 0.020616 Nov 20 03:36:10.772556 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 598/1262] 10.222.0.37 () {58 vars in 1220 bytes} [Sat Nov 20 03:36:10 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2137808715 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 03:36:13.637098 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-6465d963-13e2-434a-9a00-1ad25f4c0929 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:36:13.637597 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-6465d963-13e2-434a-9a00-1ad25f4c0929 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:36:13.643814 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6465d963-13e2-434a-9a00-1ad25f4c0929 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:13.644282 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6465d963-13e2-434a-9a00-1ad25f4c0929 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:13.645058 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6465d963-13e2-434a-9a00-1ad25f4c0929 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:13.645515 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-6465d963-13e2-434a-9a00-1ad25f4c0929 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:13.660296 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.wsgi [None req-6465d963-13e2-434a-9a00-1ad25f4c0929 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] HTTP exception thrown: Instance c45ebf32-845d-4d80-9393-0e6d2c7737e8 could not be found. Nov 20 03:36:13.660881 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-6465d963-13e2-434a-9a00-1ad25f4c0929 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Returning 404 to user: Instance c45ebf32-845d-4d80-9393-0e6d2c7737e8 could not be found. {{(pid=116113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:36:13.661694 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-6465d963-13e2-434a-9a00-1ad25f4c0929 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "DELETE /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8" status: 404 len: 111 microversion: 2.1 time: 0.028274 Nov 20 03:36:13.662216 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 665/1263] 10.222.0.37 () {58 vars in 1238 bytes} [Sat Nov 20 03:36:13 2021] DELETE /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:36:13.671058 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-96273f84-adc2-47a4-9557-959e7b417fd2 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:36:13.671677 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-96273f84-adc2-47a4-9557-959e7b417fd2 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: c45ebf32-845d-4d80-9393-0e6d2c7737e8] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:36:13.679514 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-96273f84-adc2-47a4-9557-959e7b417fd2 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:13.679992 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-96273f84-adc2-47a4-9557-959e7b417fd2 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:13.680773 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-96273f84-adc2-47a4-9557-959e7b417fd2 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:13.681215 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-96273f84-adc2-47a4-9557-959e7b417fd2 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:13.694901 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.wsgi [None req-96273f84-adc2-47a4-9557-959e7b417fd2 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] HTTP exception thrown: Instance c45ebf32-845d-4d80-9393-0e6d2c7737e8 could not be found. Nov 20 03:36:13.695489 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-96273f84-adc2-47a4-9557-959e7b417fd2 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Returning 404 to user: Instance c45ebf32-845d-4d80-9393-0e6d2c7737e8 could not be found. {{(pid=116114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:36:13.696358 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-96273f84-adc2-47a4-9557-959e7b417fd2 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8" status: 404 len: 111 microversion: 2.1 time: 0.029544 Nov 20 03:36:13.696897 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 599/1264] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:36:13 2021] GET /compute/v2.1/servers/c45ebf32-845d-4d80-9393-0e6d2c7737e8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:36:14.822142 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-4d5e557c-6f88-4af2-8f15-eb25759d14e1 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:36:14.822648 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.compute.api [None req-4d5e557c-6f88-4af2-8f15-eb25759d14e1 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116113) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:36:14.828917 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4d5e557c-6f88-4af2-8f15-eb25759d14e1 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:14.829370 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4d5e557c-6f88-4af2-8f15-eb25759d14e1 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:14.830147 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4d5e557c-6f88-4af2-8f15-eb25759d14e1 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:14.830587 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG oslo_concurrency.lockutils [None req-4d5e557c-6f88-4af2-8f15-eb25759d14e1 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:14.843734 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.wsgi [None req-4d5e557c-6f88-4af2-8f15-eb25759d14e1 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] HTTP exception thrown: Instance e2109e70-6d36-409e-a430-4e36ba685082 could not be found. Nov 20 03:36:14.844319 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: DEBUG nova.api.openstack.wsgi [None req-4d5e557c-6f88-4af2-8f15-eb25759d14e1 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Returning 404 to user: Instance e2109e70-6d36-409e-a430-4e36ba685082 could not be found. {{(pid=116113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:36:14.845127 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO nova.api.openstack.requestlog [None req-4d5e557c-6f88-4af2-8f15-eb25759d14e1 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "DELETE /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 404 len: 111 microversion: 2.1 time: 0.026707 Nov 20 03:36:14.845644 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: [pid: 116113|app: 0|req: 666/1265] 10.222.0.37 () {58 vars in 1238 bytes} [Sat Nov 20 03:36:14 2021] DELETE /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:36:14.853741 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-e99e621a-3617-4e55-a509-d7fda58ae802 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Calling method '>' {{(pid=116114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 03:36:14.854390 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.compute.api [None req-e99e621a-3617-4e55-a509-d7fda58ae802 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] [instance: e2109e70-6d36-409e-a430-4e36ba685082] Fetching instance by UUID {{(pid=116114) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 03:36:14.860656 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e99e621a-3617-4e55-a509-d7fda58ae802 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:14.861142 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e99e621a-3617-4e55-a509-d7fda58ae802 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:14.861931 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e99e621a-3617-4e55-a509-d7fda58ae802 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 03:36:14.862373 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG oslo_concurrency.lockutils [None req-e99e621a-3617-4e55-a509-d7fda58ae802 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Lock "692e9fe6-a45f-4304-841f-fd5e8ac1537b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 03:36:14.875722 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.wsgi [None req-e99e621a-3617-4e55-a509-d7fda58ae802 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] HTTP exception thrown: Instance e2109e70-6d36-409e-a430-4e36ba685082 could not be found. Nov 20 03:36:14.876328 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: DEBUG nova.api.openstack.wsgi [None req-e99e621a-3617-4e55-a509-d7fda58ae802 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] Returning 404 to user: Instance e2109e70-6d36-409e-a430-4e36ba685082 could not be found. {{(pid=116114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 03:36:14.877137 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO nova.api.openstack.requestlog [None req-e99e621a-3617-4e55-a509-d7fda58ae802 tempest-AttachVolumeTestJSON-1294934301 tempest-AttachVolumeTestJSON-1294934301-project] 10.222.0.37 "GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082" status: 404 len: 111 microversion: 2.1 time: 0.027629 Nov 20 03:36:14.877645 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: [pid: 116114|app: 0|req: 600/1266] 10.222.0.37 () {58 vars in 1235 bytes} [Sat Nov 20 03:36:14 2021] GET /compute/v2.1/servers/e2109e70-6d36-409e-a430-4e36ba685082 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 03:37:39.018642 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 03:37:39.019232 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: Sat Nov 20 03:37:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 03:39:19.155060 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 03:39:19.155831 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: Sat Nov 20 03:39:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 03:39:25.266381 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 03:39:25.266903 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: Sat Nov 20 03:39:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 03:40:40.433468 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 03:40:40.434083 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: Sat Nov 20 03:40:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 03:40:59.035010 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 03:40:59.035547 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: Sat Nov 20 03:40:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 03:41:17.262299 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 03:41:17.263002 dv-cinder-818037-5-iscsi devstack@n-api.service[116114]: Sat Nov 20 03:41:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 03:41:29.139481 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 03:41:29.140094 dv-cinder-818037-5-iscsi devstack@n-api.service[116113]: Sat Nov 20 03:41:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!